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COMPARATIVE RETENTION OF TYPEWRITING AND 
OF SUBSTITUTION WITH ANALOGOUS MATERIAL 


FRANK N. FREEMAN AND ETHEL M. ABERNETHY 


PROBLEM 


It is commonly said that motor habits deteriorate less with the 
lapse of time than do associations between words or other symbols. 
Swift and others have cited examples of the retention of such habits as 
ball tossing and typewriting over long periods of time with small loss. 
Such retention has been contrasted with the rapid loss of associations 
between nonsense syllables and the somewhat less rapid loss in 
memory of sense material. 

The question has naturally been raised whether this difference 
in retention is due to the fact that one habit is motor and the other 
ideational, or at least that the overt movements are more prominent 
in the one than in the other activity, or whether the difference is due 
rather to the structure of the forms of learning which are compared. 
For example, the motor learning might consist of a small number of 
the same operations repeated over and over again, while the ideational 
learning consisted of a larger number of operations, each one of which 
was repeated less often. Thorndike refers to such a structural 
difference when he suggests that the greater permanence of motor 
learning may be due to a greater amount of overlearning. 

The present experiment was planned with the purpose of setting 
up a comparison in retention between two forms of learning which 
should be as similar as possible in structure and should differ chiefly 
in the fact that the one involved overt movements and the other 
consisted primarily of associations of the ideational type. Except 
for this difference the content of the two forms of learning was to be 
the same. The first form, the motor learning, consisted in learning 
to typewrite a short paragraph with the keys covered with blank caps 


and a drawing of the keyboard placed in view of the learner. The 
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corresponding ideational learning consisted in translating the same 
paragraph into digits, following a key containing the letters of the 
alphabet and corresponding numbers placed before the learner. 


PREVIOUS STUDIES 


After the experiment was begun, the report of the experiment by 
McGeoch and Melton appeared.! These authors give a detailed 
review of the literature, and point out that no previous experiment 
made a direct comparison between motor learning and ideational 
learning. In their own experiment McGeoch and Melton compare 
the permanence of the ability to run three mazes with the permanence 
of the memory of three series of nonsense syllables. The interval 
between the first learning and the relearning was one week. On the 
basis of their results these authors challenge the common belief that 
motor learning possesses superior permanence. When retention 
was measured in terms of saving in trials the nonsense syllable lists 
were better retained than were the mazes. When the saving in time 
and errors was compared there was no marked difference. Recall 
scores calculated in terms of errors showed greater permanence of the 
maze habits, but they are not regarded as a valid basis of comparison. 

The experiment of McGeoch and Melton makes a more direct 
comparison between overt motor learning and the formation of internal 
associations than had previously been set up. The significance of 
their experiment for our problem, however, is limited in two respects. 
In the first place, while the general conditions surrounding the two 
types of learning and the method of calculating the permanence of 
effect are similar, the two forms of learning differ radically in their 
structure. It is not possible to say, therefore, whether the presence 
of the overt movement in the one type of learning does or does not 
influence its permanence. In the second place, the interval between 
the learning and the relearning—one week—is too short to indicate 
what differences may exist throughout longer intervals. 


PROCEDURE 


Since the two forms of learning were so closely similar, it was 
necessary to have different subjects learn the two tasks. Fifty sub- 





1 McGeoch, John A., and Melton, Arthur W.: The Comparative Retention 
Values of Maze Habits and of Nonsense Syllables. Journal of Experimental 
Psychology, Oct., 1929. 
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jects in all completed the learning-and the first relearning. Twenty- 


five learned the typewriting and twenty-five the substitution. The 
two groups were equated approximately on the basis of mental-test 
scores (Terman Group Test). All the subjects were young women, 
members of college classes in psychology. None was at the beginning 
of the experiment in the least familiar with the keyboard of the 
typewriter. 

Forty-four of these subjects, twenty-two in each group, completed, 
without any apparent irregularity in the experimental procedure, 
the second relearning. Six were rejected because of rehearsal after 
the first relearning or illness at the time for the second relearning. 

Both groups learned the same material, consisting of a short 
paragraph which contained every letter of the alphabet. 

Each individual of both groups worked in approximately fifty- 
minute practice periods a day until the task was completely learned. 
Each trial was timed in seconds by means of a stop watch. | 

The criterion of completion of the learning was the same for both 
groups—namely, two successive correct repetitions of the paragraph 
without the use of the diagram. 

The detailed method of presentation to the typewriting group was 
as follows: The keys of the typewriter were covered with blank 
caps. A large diagram was kept on the wall in front of the subject 
until one errorless copy had been made. After this first correct copy 
the subject practised without the diagram. At the beginning of the 
first learning period the subjects were given the necessary information 
concerning the mechanism of the typewriter and the conventional 
position of the fingers upon the keyboard. All practice was upon the 
paragraph to be learned and every trial in practice was timed. 

The presentation to the substitution group was made as follows: 
This group translated the paragraph into number symbols. On a 
small diagram, a copy of the large one used for the typewriting group, 
the letters were numbered according to their position on the keyboard. 
Numbers were also assigned for punctuation marks, the shift key, and 
the spacer, so that for every movement made in typing there was 
a particular number symbol. After going through the paragraph 
once silently, the subject recalled what she could, speaking the numbers 
aloud. The silent translation with the diagram and the recall aloud 
alternated until the subject could go through two successive correct 
recalls. At the beginning of subsequent learning periods a recall 
preceded the silent repetition. 
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The first relearning came two weeks after the completion of the 
original learning; the second, eight weeks after the first relearning, 
The procedure of relearning was the same as that of learning. In both 
the typewriting and the substitution the relearning was preceded by 
recall without the diagram. The criterion was the same as for the 
first learning—namely, two successive correct repetitions without the 
diagram. 

The following were counted as errors in the case of both groups: 
Omissions, insertions, transportations, and substitutions. The same 
experimenter conducted the entire experiment. With each member 
of the typewriting group the experimenter was assisted by a teacher 
of typewriting, Miss Thelma Stone. The attempt was made to keep 
all conditions as constant as possible. Throughout the experiment 
the same room was used (for a particular subject), the same position 
in the room, and approximately the same time of day. Except for 
two subjects, all the experimental work was done in the same room and 
in the late afternoon. Subjects were warned at the close of each period 
to avoid rehearsing, and were questioned at the beginning of the follow- 
ing period. Whenever any condition was known to be irregular, the 
subject’s record was discarded. Sixty subjects began the experiment, 
ten being eliminated. 

It is clear that the situation and the learning process in the case of 
the two groups of learners were very similar. Both learned to translate 
the same verbal text. The number of items translated was there- 
fore the same, and the perceptual and ideational content connected 
with the text was the same. Each letter, punctuation mark, and 
space of the text became associated with a definite reaction. In the 
one case an overt movement was a part of this reaction and in the 
other case it was not. Of course the overt movement was not all there 
was to the one reaction, and internal or incipient movements were not 
excluded from the other. But the overt movement constitutes a 
prominent distinguishing mark, and the reactions were very similar 
except for this distinction. 


RESULTS 


The comparisons of the permanence of learning in the two groups 
are presented in terms of saving scores. ‘The saving scores are calcu- 
lated for the three measures, number of errors, number of repetitions, 
and time. 
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The mean scores and standard deviations in learning and first 
relearning of the two groups are presented in Table I. It will be seen 
that the number of errors made by the two groups in the original 
learning is approximately equal, but that typewriting required 
considerably more trials and longer time than did substitution. 

The saving scores on the first relearning, at the end of two weeks, 
are givenin Table II. The percentage of saving is remarkably similar 
in all three measures, number of errors, number of repetitions, and 
time. Thus far the results seem to agree with those of McGeoch and 
Melton. 

Since three of each group dropped out before the second relearning, 
leaving twenty-two instead of twenty-five in each group, the mean 
scores of learning and first relearning, as well as of the second relearn- 
ing, are presented for these groups. They are shown in Table III. 

The saving scores for these groups are shown in Table IV. They 
do not differ significantly from those of the entire groups. 

The saving scores of the second relearning, eight weeks after the 
first relearning, tell a different story. They are calculated in two 
ways, first taking as a base the means of the original learning, and, 
second, taking as a base the sum of the means of the original learning 
and the first relearning. The saving scores, calculated by these two 
methods, are given in Tables V and VI. 

TaBLeE I.—Tue AveraGE Scores IN LEARNING AND First RELEARNING IN 


TYPEWRITING AND IN SUBSTITUTION. TWENTY-FIVE SuBJEcTs IN Eacu 
Group 





Time in 
seconds 





| Errors Repetitions 
Measure Group | 





SD |Mean!SD)| Mean SD 





| Mean 





Learning............. | Substitution |158.80/123.74| 17.24/6. 10/3560. 6811105. 47 
Typewriting 154.48 127, 15) 25.36 9.80,6358.52/1535.81 
Substitution | 15.28! 12.67) 5.64/1.62| 790.20! 292.17 
Typewriting 17.52 11.05, 8.24)3.27/1473.92| 555.24 








First relearning....... 

















TaBLe IJ.—Savine Scores BAsED ON MEANS FROM TABLE I 





Group Errors Repetitions Time 
Substitution............... 90.38 67.29 77.81 
| 88 . 66 67.51 76.82 
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TaBLeE III.—TuHeE AvEeRAGE Scores 1n LEARNING, IN First RELEARNING, SECOND 
RELEARNING AND THE SUM OF THE ScORES IN LEARNING AND FIRstT 
RELEARNING IN TYPEWRITING AND SUBSTITUTION. TWENTY-TWO 
SuBJECTs IN Eacu Group 























. . 
Errors = | eer esc 
Measure Group e | 
Mean| SD /Mean| SD | Mean SD 

a Gael aes ER eee 

Learning...... || Substitution 165. 68 127. 41 17.50) 6. 45/3596. 59 1159.61 
Typewriting 136. 36 84. 41| 25. 68}10. 06'6385 . 18,1503 .97 

First relearning...... Substitution | 14.95 13.32, 5.59) 1.72) 792.36 311.06 
| Typewriting | 16. 45, 11. 05 8.27) 3. 24 1477.36, 559 . 28 

Second relearning.... Substitution | 38.36, 20.03 8.36 2. 04/1228.00, 364.81 





| Typewriting | 12.00 5.96 6.45) Ri 62 1242. 59) 124.26 


Total learning and | Substitution |180.63 129.44 23.09 7. 24 4388. 95) 1311.74 
the first relearning. .| Typewriting 152.81) 89.88 33.95 11. 18 (7862. 54/1722. 13 





TaBLE [V.—SavinG Scores, THE First RELEARNING IN RELATION TO LEARNING, 
BasSED ON THE MEANS OF TABLE III 








Group | Errors | ee Time 
Substitution............... 90.98 | 68 .06 | 77.97 
_ ee er 87 .94 | 67.80 76.86 





TABLE V.—SavING ScorREs, THE SECOND RELEARNING IN RELATION TO LEARNING, 
BASED ON THE MEANS OF TABLE III 





| 





Group | Errors Repetitions | Time 
Substitution...............| 76.85 52.23 | 65.86 
eR 91.20 | 74.88 |’ 80.54 





TaBLE VI.—SavinG ScorgEs, THE SECOND RELEARNING IN RELATION TO LEARNING 
PLUs THE First RELEARNING, BASED ON THE MEANS OF TaBLE III 














Group | Errors | Repetitions | Time 

| | 
Substitution...............| 78.76 | 63.79 | 72.02 
Typewriting...............| 92.15 | 81.00 | 84.20 








TABLI 


Error 
Repe 
Time 


afte! 
tion 
the 
furt 
on t 
gail 
of t 
rep 
typ 
It : 
lon, 
mo 
Ove 


the 


is ( 
thi 
Th 
wil 
to 

de 


eX! 
ce 


gr 
af: 


vit 
































Comparative Retention 645 


TasLE VII.—DiIFFERENCES BETWEEN THE MEANS, First RELEARNING AND 


OND 
SeconpD RELEARNING, BASED ON THE MEANS oF TABLE III 





-_— 


Substitution © Typewriting 





D PE of D D PE of D 


— eR ic stcdenswcascseneesl a Eee 3.45 — 4.45 1.80 
) Repetitions.................. + 2.77 .38 — 1.82 51 


Time in seconds.............. | +435. 64 68.94 | —234.77 82.39 
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-06 In view of the close similarity between the amount of retention 
Ses after two weeks, the contrast after ten weeks is startling. In substitu- 
os tion, the loss which began during the first two weeks continued during 
14 the succeeding eight weeks. In typewriting, however, there was no 
13 further loss. On the contrary, there wassome gain, for the saving scores 
ae on the second relearning were higher than on the first relearning. This 
gain is brought out in another way by a comparison of the mean scores 

NG, of the first and second relearning, shown in Table VII.! The errors, 
repetitions, and time in substitution have all increased, whereas in i 
typewriting they have all decreased. The difference is unmistakable. il 
It seems to confirm without question the traditional belief that, for Pay. 
longer periods of time, learning which involves overt movements is a 
more permanently retained than is learning which does not involve Pe 
— overt movements. The difference is so great that deterioration of ; 
the overt habit seems actually to be halted after two weeks. hy 

NG, It may be objected that the greater permanence of the typewriting Sy 
is due to the fact that it required more trials and more time to learn het 
this process. It may be thought that this constitutes overlearning. “ales 
a. There was no overlearning in the typewriting, however, in comparison 
with substitution. The same number of analogous operations had 

to be learned in the two cases, and they were learned to the same 

— degree. < 
. The typewriting group did, to be sure, require more time, but this 

NG excess in time is allowed for by calculating the saving in terms of per- 
centage. Furthermore, whatever effect may have resulted from this ee 
greater expenditure of time did not appear on the first relearning, 
oe after two weeks. It is the contrast between this equality in retention 





‘ These differences in means are confirmed by differences in the number of indi- i 
viduals whose scores increased or decreased between the first and second learning. og 


646 The Journal of Educational Psychology 


during the first period and the marked inequality in retention during 
the second period which is important. 

Again, it is noteworthy that the scores on the typewriting at the 
second relearning are actually higher than they were eight weeks 
before. The first relearning undoubtedly affected these scores; 
but the significant fact is that it did not similarly affect the scores in 
substitution. 


SUMMARY 


This experiment was conducted to compare the permanence of 
‘‘motor”’ learning with that of ‘‘ideational” learning. Earlier studies 
failed to settle the question because, first, the two types of learning 
were not directly compared under the same conditions, and, second, 
the cases of ‘‘motor’’ and ‘‘ideational” learning which were compared 
differed widely in structure as well as in the relative emphasis on overt 
movements. The recent experiment by McGeoch and Melton 
overcame the first difficulty but not the second. 

In the present experiment the permanence of the effect of learning 
to typewrite a given text, using a diagram of the keyboard with the 
keys themselves covered, was compared with that of learning to sub- 
stitute digits for letters with the same text and using a similar diagram 
with a digit added to accompany each letter. The same number of 
associations was thus learned in each of the two tasks. Each was 
learned to the point of two successive correct repetitions. There 
was therefore no more overlearning in the one case than in the other. 

Each task was relearned after two weeks and again after an addi- 
tional eight weeks. Twenty-five young women underwent the learn- 
ing and first relearning of each task and twenty-two underwent the 
second relearning of each. 

The typewriting required more time and a large number of trials 
to learn than did the substitution, but the percentage of saving in 
errors, time, and trials on the first relearning, after two weeks, was the 
same, within the limits of statistical error. For this period of time 
there was no difference in the permanence of the two types of learning. 
The similarity in the saving scores after the two-weeks interval is a 
check on the comparability of the two tasks. 

After eight weeks more, or ten weeks from original learning, on 
the other hand, the amount which had been retained was very different. 
When the second relearning was compared with the original learning 
plus the first relearning, the percentage of saving in typewriting 
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exceeded that in substitution by 13.4 in errors, 17.2 in trials, and 12.2 
in time. In substitution there was a marked loss in errors, trials, and 
time between the first and second relearning, whereas in typewriting 
there was a gain in each of these measures, varying from over twice 
the probable error to over three times the probable error. 

The conclusion is that, for the types of learning studied, the 
existence of overt movements as part of a learning process makes the 
effect of learning more permanent over a ten-weeks period of time than 
when overt movements are not present, although it does not appear 
to affect the permanence over the shorter period of two weeks. 


.- 





THE CHARACTERISTICS OF SPELLING ERRORS! 


JAMES E. MENDENHALL 


The Lincoln School of Teachers College, Columbia University 


During the last three decades remarkable progress has been 
achieved in the field of English spelling. The content of spelling 
textbooks has been altered to include words that are commonly used 
by children and adults. Classroom methods have increasingly empha- 
sized the learning of words in a natural context setting. Planned 
drills for initial learning and for relearning have been established as 
effective learning devices. Practice has been centered upon the words 
that are misspelled, rather than wastefully upon words already known. 
Systematic devices of self-drill and self-checking have promoted other 
economies of learning. 

Despite this increase in knowledge and the consequent reforms, 
we are not completely informed about the exact nature of spelling 
errors and of the best manner to overcome them. In the present 
article an attempt has been made to contribute additional information 
to our knowledge of the nature of spelling errors. This information 
may have some important implications for the problem of spelling 
teaching. 

In 1919 Horn? expressed a point of view relative to the character 
of misspellings for a particular word: ‘‘ Recent investigations of the 
misspellings of pupils have shown that for most words there is no one 
error which is characteristic of a sufficiently large percentage of mis- 
spellings to warrant calling attention to it. Relatively few words 
have a type of error which includes as much as fifty per cent of the 
misspellings of pupils attempting those words. For most words, the 
percentage of the most frequent type of error to the total misspellings 
is very small.”” Since 1919 Horn has not seriously modified this 
statement. 





1 Some of the material for this article has been selected from ‘‘An Analysis of 
Spelling Errors,’”’ by James E. Mendenhall. The Lincoln School of Teachers Col- 
lege, Bureau of Publications, Teachers College, Columbia University, New York, 
1930. 

2 Horn, Ernest: ‘Principles of Method in Teaching Spelling as Derived from 
Scientific Investigation.’”’ Eighteenth Yearbook of the National Society for the 
Study of Education, Part II, Public School Publishing Company, Bloomington, 
Ill., 1919, p. 67. 
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To the point the writer analyzed letter by letter a sample of one 
hundred eighty-four words administered to one hundred pupils in 
Grade III, and a sample of ninety-two words given to one hundred 
pupils in Grade IV. In each sample the word list was one grade level 
above that of the pupils—that is, a fourth grade list of words was 
presented to Grade III. This device produced for the analysis a 
larger number of mistakes than would have been normally secured. 

Most studies of spelling errors have considered only the most 
frequent error for a word. In the present study every error for a 
word was analyzed. Conclusions about the commonness of a particu- 
lar error will depend upon which type of analysis is employed. For 
example, if only the most frequent error for the word ‘‘trouble’’ is 
analyzed, the omission of the letter “‘u”’ characterizes forty per cent 
of the total errors for the word. If all of the errors are analyzed, 
the omission of the letter ‘‘u’”’ characterizes sixty per cent of the total 
errors. Table I displays the means of the per cents for the analysis 
of the most frequent error (partial analysis) and for the analysis of all 
of the errors (the complete analysis). In Grade III the per cent is 
raised from twenty-three to forty-eight; in Grade IV, from twenty-six 
to forty-five. These are significant increases. (These per cents 
would have been signally larger had the word lists been of the same 
grade level as the pupils.) Although the reader will decide for him- 
self, the writer believes that these per cents are sufficiently large to 
warrant special attention in spelling procedures. 

Another matter of possible interest to students of spelling is dis- 
played in Fig. 1. This figure shows the number of errors in successive 
letter positions of words of various lengths. For example, for the 
word “‘trouble”’ there were no errors in the ‘‘t”’ or first position, five 
errors in the ‘‘r” or second position, eight errors in the ‘‘o”’ or third 
position, etc. These data for “trouble” were assembled with similar 
data for other words of seven letters. For each letter position means 
were computed. From these means Fig. 1 was constructed. This 
figure exhibits a number of important facts. In words of any length, 
there is a marked increase in the‘number of errors from the first to the 
last letter position. In an average four-letter word the ratio of the 
number of errors in the first position to the number in the last position 
is one to three; in an average nine-letter word, the ratio is one to thirty. 
In words of any length the position of letters with the greatest number 
of errors is at the center or directly to the right of center of the word. 
The number of letters in a word does not seem to influence the difficulty 
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of the initial letters. In fact pupils can spell the initial four letters 
of a nine-letter word as easily as the initial four letters of a five-letter 
word. 
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SUCCESSIVE LETTERS OF WORDS 
N Words of: N Words of: 
10 Fou letters ——— 21 Seven letters ——— 
26 Five letters ——-— 10 Eight .letters ---<——-- — 
23 Six letters —ao 6 Nine letters oman 
Fig. 1. 


In the sample from Grade III the number of errors in one letter 
position was correlated with the number of errors in every other posi- 
tion and with the difficulty of the word. For six-letter words, these 
data appear in Table II. The original correlations appear in Roman 
type; the partial correlations (difficulty constant) appear in italics 
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” TaBLE I1.—ME£EANS AND STANDARD DeEvIATIONS or Per Cent or ToTaL ERRorS it i 
- ror Worps ACCOUNTED FOR BY Most Frequent Error, Most FREQUENT ed: 
Error DETERMINED BY (A) PaRTIAL ANALYsIS OF ERRORS AND (B) VS RR 
CompteTs ANALYsIs or ALL ERRors ee ae 
Per cent total | Per cent total ‘i Se i 
errors, partial | errors, com- Difference Se tas | 
analysis | plete analysis bey 
Grade III hanes IV) N = 184: EM | 
Mean.. bee PERE hn ee 23.04 48 .29 25.25 “se 
ON) oo cas cekaeheuweu ogee shes 11.54 17.69 1.18 a 
Grade IV _— V) N = 92: 1 a 
Mean.. eee ee 25.95 44.97 19.02 oe 
RR Te ee a eae ee Ree 29.91 17.86 3.07 reat 
| ; oa | 
Grade III | Grade IV ih 
Correlation coefficient (per cent FS Hi 
partial and per cent complete)... .466 324 ey dl 
i Bra a ay .06 .09 ast 
TaBLE II.—CorRELATIONS AMONG NuMBER OF Errors IN Successive LETTERS } ae , 
oF FortTy-THREE SIx-LETTER Worps, Grape III (List IV)! +? ime 
Successive . f ia : 
hela 2 3 4 5 6 Difficulty \ mad 
1 350 | .220 301 | .255 141 413 ee 
241 | —.O44 084 | 085 105 Bit 
2 .490 | .304 | .210 | 136 .560 Me 5 
227 —.120 | —.162 — .243 Py 
3 .513 060 | — -027 .609 @ 
“1756 | —.443 | — .528 a i 
4 | .319 .298 .674 my 
: | | —.110 — .102 yt 
- 5 | | .559 .572 lon 
Sl- ; . 864 4 A b 
Se 6 | | . 536 eet 
an . —r Be i 
om ‘Original correlations in Roman type. First order partial correlations (diffi- i. he 


culty constant) in italic type. 
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From the original correlations it appears that the association between 
the number of errors in adjacent positions is distinctly higher than 
those between the numbers in non-adjacent positions. When a letter 
in any position is in error, there is a decided tendency to err in the 
immediately succeeding letter. The correlation between the number 
of errors in any letter position and difficulty is significantly higher 
than the correlation between the numbers in any two letter positions, 
adjacent or non-adjacent. 

From the partial correlations (difficulty constant) practically all 
correlations are materially reduced in size. The tendency to misspell 
adjacent letters is greater in the first part of a word than in the last 
part of the word, except in the case of the last two letters. If the 
second or third letter is misspelled, later letters are generally correct. 

Altogether the writer administered 2300 words to one hundred 
public-school children, Grades I-VI. For every word, the most 
frequent error was determined. For the word “trouble,” this error was 
‘“‘troble,”’ the omission of the letter ‘‘u’’ being the principal source of 
error. Counting the letter “‘u’’ in the word “‘trouble”’ as one unit, the 
total frequency of error for this letter was compiled. A similar pro- 
cedure was followed in the case of other letters. The second column 
of Table III portrays the per cents of the grand total based upon an 
assembly of the letters most frequently in error. 

In a sample of 10,000 letters (from any 2000 words, averaging five 
letters in length), the letter ‘‘e’’ would occur 1300 times, or thirteen 
per cent of the total times. (The third column of Table III shows 
the per cents for the letter ‘‘e’’ and for other letters.) Since the 
letter ‘‘e’’ accounts for thirteen per cent of 10,000 letters, we would 
normally expect it to occasion thirteen per cent of the errors in words. 
This expectation is supported by the high rank-order coefficient of 
correlation of .853 between error and occurrence. However, such a 
correlation obscures the true nature of the case. The letter ‘‘e,” 
occurring thirteen per cent of the time, is associated with twenty-three 
per cent of all the errors, a difference of ten per cent. From the fourth 
column of Table III it can be observed that the letters ‘‘e,” “‘a,”’ “‘i,” 
and ‘‘u”’ are most frequently associated with error, and that the letters 
“tt. “n” “h” and “r” are least frequently accompaniments of error. 
It is interesting to note that the four most difficult letters are vowels, 
and that the four least difficult letters are consonants. 

There are other aspects of words that are slightly but not signifi- 
cantly associated with the difficulty of words. The brevity of this 
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article precludes the incorporation of tables to display the supporting 
data. However, the conclusions from these tables may be of some 
interest to the reader. The length of words is only slightly associated 
with spelling difficulty; difficulty is a function of particular letters 
(singly or combined) rather than of the gross number of letters. The 


TaBLE IIJ].—FREQUENCY OF ERROR AND OF OCCURRENCE OF VARIOUS LETTERS 
OF THE ALPHABET 

















Sashes Error in 1,857 | Occurrence in Difference (occur- 
letters, 10,000 letters,! rence-error), 
| per cent | per cent | per cent 
a | 13.2 | 7.78 — 5.42 
b | 1.0 | 1.41 41 
c | 4.6 | 2.96 — 1.64 
d 3.4 4.02 62 
e 22.9 | 12.77 —10.13 
f 6 | 1.97 1.37 
g 1.0 | 1.74 | 74 
h | 1.9 | 5.95 | 4.05 
i | 11.0 | 6.67 — 4.33 
j | 3 | 57 | 27 
k | 1.3 | 74 | —- 6 
l | 3.5 | 3.72 | .22 
m | 1.0 | 2.88 | 1.88 
n | 2.3 | 6.86 | 4.56 
0 | 7.4 | 8.07 | .67 
p | 1.5 | 2.23 | .73 
q | a .08 | - .02 
r | 3.3 6.51 | 3.21 
s 5.1 | 6.22 | 1.12 
t | 2.7 | 8.55 | 5.85 
u | 6.9 | 3.08 | — 3.82 
v | 2 | 1.12 | 92 
Ww | 2.2 | 1.76 | — .44 
x | = .27 | .07 
y | 2.5 | 1.96 | — .54 
z | 0 | 17 | 17 
| 100.1 | 100.06 
| | 
rho (error and occurrence)..............0.0ceseeeeeee 853 + .04 





‘The per cents were computed from the letters and their frequencies which 
appeared in ‘Secret Messages, How to Read and How to Write Them,’’ p. 23, by 
Paul B. Thomas. Alfred A. Knopf, New York, 1929. 
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number of vowels, the number of syllables, the position of the accent, 
the confusion of words—none of these exhibits a consistent or high 
association with word difficulty. 

Let us turn from facts of general scientific import to facts of 
particular significance to the teaching of spelling. Hollingworth! has 
expressed an opinion that prevails in the field: ‘“‘ English spelling must 
be acquired by the formation of a comparatively few fundamental bonds.”’ 
Horn? justifies this position by citing the unphonetic character of 
English spelling. However, he introduces an important qualification: 
“It is probable that many children who have not been taught phonics 
have made their own comparisons between words and have in that 
way built up a sort of phonic system of their own.” In spelling, there- 
fore, would it not be the wise course to guide the development of these 
generalizations rather than to leave their formation to chance? 

To further the growth of generalizations, two possible methods of 
grouping words present themselves—grouping by like auditory 
elements, and grouping by like visual elements. The writer’s study 
showed that fifty-one per cent of all errors for words are reasonably 
phonetic renditions. These errors that are phonetically correct 
would not be reduced or eliminated by an auditory method of grouping. 
Studies by Gates* emphasize the importance of visual perception in 
spelling, and imply that visual grouping should prove most effective 
in learning. 

The writer made a study of the errors for three hundred fifty words 
from Grade IV that may have some bearing upon word grouping in 
spelling instruction. The words were classified by common types of 
error. Practically all of the words for a grade fell within the following 
categories: (1) The addition or omission (a) of the second of a double 
letter, (b) of a final letter, (c) of silent letters, (d) of key consonants, 
and (e) of central syllables; and (2) the substitution (a) of other words 
for the correct ones, and (b) of one vowel for another in the second 





1 Hollingworth, Leta S.: “‘The Psychology of Special Disability in Spelling.” 
New York: Bureau of Publications, Teachers College, Columbia University, 
Contributions to Education, No. 88, 1918, p. 65. 

2 Horn, Ernest: The Child’s Early Experience with the Letter A. Journal of 
Educational Psychology, Vol. XXI, March, 1929, pp. 161-162. 

3 Gates, Arthur I.: ‘‘The Psychology of Reading and Spelling.”” New York: 
Bureau of Publications, Teachers College, Columbia University, Contributions to 
Education, 1922, p. 86; and Gates, Arthur I.: A Study of the Réle of Visual Per- 
ception, Intelligence, and Certain Associative Processes in Reading and Spelling. 
Journal of Educational Psychology, Vol. XVII, October, 1926, p. 444. 
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syllable of words. This classification suggested the use of common 
errors as a basis for grouping. For example, words like “address,” 
“banner,” ‘‘slippers” (and others from Category la) might be taught 
together. These words have a common visual feature (the double 
letter) and a common error (the omission of one member of a double 
letter). Likewise, another group of words might be formed to include 
“chain,” ‘gain,’ ‘‘grain,’ ‘‘maid,”’ and ‘“pain.’”’ These words 
exhibit a common visual element (‘‘ai’’) and a common type of error 
(the omission of the letter “i’’). The words, ‘ankle,’ ‘‘bridle,”’ 
“eouple,” and “‘gentle’’ have a common error (the transposition of 
the letters ‘‘l’’ and ‘‘e’’). Another group would incorporate “‘apron,”’ 
“cabin,” ‘‘comfort,” “‘habit,’’ ‘‘palace,”’ and “‘postal.’”’ These words 
commonly have errors in the second syllable, in which it is difficult 
to ascertain the vowel from the sound of the syllable. In this last 
case the system of grouping rests upon the empirical study of error 
rather than upon common visual features of words. 

In essence the writer suggests a visual method of instruction that 
is based upon the common errors for words. The visual method of 
grouping alone reveals so many possibilities that the organizer is at a 
loss to select the optimal one. However, if commonality of error 
is made the basis, the problem of grouping is greatly simplified. 


SUMMARY 


The conclusions and implications from the study can be stated 
succinctly as follows: 

1. The most frequent error for a word characterizes fifty per cent 
of the misspellings for that word. This per cent is high enough to 
warrant special consideration. 

2. In general, the hard spot of a word is either at the center or 
immediately-at the right of center. The initial letters of a short word 
are no more difficult to spell than the initial letters of a long word. 

3. The number of errors in any one letter position are associated 
with the number in any other position less closely than with the 
difficulty of the word. 

4. In general, the letters occurring most frequently are most often 
in error. Moreover, some letters ‘‘e,” ‘‘a,” ‘‘i,”’ and “‘u” are asso- 
ciated with error much more frequently than their occurrence warrants. 

5. Difficulty is associated with particular letters (singly or com- 
bined) more closely than with general aspects of words, such as length, 
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the number of vowels, the number of syllables, and the position of the 
accent. 

6. The writer suggests the use of a method of grouping based upon 
two features of words and their errors: (a2) Common visual elements 
and (b) common types of errors. The efficacy of this method, of 
course, awaits further experimental investigation. 
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ON THE ANALYSIS OF CAUSATION 


JACK W. DUNLAP AND EDWARD E. CURETON 


Territorial Normal and Training School, Honolulu, Hawaii 


I. INTRODUCTION 


Much has been written about the indiscriminate use of statistics 
in the analysis of the causes underlying observed phenomena in various 
fields. Many of these problems of causation are not, however, 
insoluble. Statistical procedures have been developed by many 
workers during the last several years which when properly applied 
are capable of throwing much light on them, but which when improp- 
erly applied lead to serious errors in interpretations and conclusions. 
These contributions have appeared in the special journals of many 
different fields, and at irregular intervals. The purpose of this paper 
is to bring together some of these techniques, add certain others, 
point out a few of the relationships between them, and show their 
applications to various problems. The illustrative problems con- 
sidered hereafter will be taken from the major fields of interest of the 
writers, namely education and psychology. 


II. THe PRINCIPLE OF THE ANALYSIS OF VARIANCE 


Most problems of causation resolve\ themselves fundamentally 
into a consideration of the proportions of the variability in an effect 
attributable to the different causes under consideration. These prob- 
lems can best be attacked by the methods of the analysis of variance 
and by other techniques which depend for their significance upon their 
relationships with these methods. 

Let x, be a score (measured from its mean, #,) in the “‘dependent”’ 
variable (criterion or effect): 

Let 21, 22, . .. 2, be scores (measured from their respective 
means, #1, 2, . . . Z,) in the ‘‘independent’’* variables (causes). 

Consider the simplest case of causation, where 

Yo = M+ 22. 
Then 


ov)? = o7(142) = 6)" + a2? + 2oioer ir. 





* An “independent”’ variable is to be thought of as one whose observed values 
are used to predict values of a ‘“‘dependent”’ variable. Mathematical inde- 
pendence is not implied here. 
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If x, and 22 are uncorrelated, 712 = 0, and 
oo” = 0," + a2? (1) 

This equation (1) is the basic formula for the analysis of variance, 
The variance of any variable may be defined as the mean square 
deviation about the arithmetic mean, or as the square of the standard 
deviation. Equation (1) may then be expressed as follows: 

If every score in a dependent (mathematically) variable be composed 
of the sum of the scores in two independent (mathematically) variables, 
then the variance of the dependent variable equals the sum of the variances 
of the independent variables. This rule may readily be extended to 
cover the case of n mutually independent variables. Furthermore, 
if any of these be composed of m other mutually independent variables 
(on which observations are available), the same rule may be applied 
to effect an analysis of these remote causes. The ratio of the variance 
of one of the independent variables to that of the criterion gives a 
measure of the proportion of the criterion (considered as an effect) 
due to that variable (considered as a cause). The sum of all such 
ratios will of course equal one. 

The fact that one variable may be the sum of several others does 
not mean necessarily that it is to be considered as an effect. In fact, 
no mathematical relationship in itself can ever indicate the direction 
of causation; this must be inferred from the nature of the experimental 
conditions or on other a priori grounds. 


III. CorRRELATION 


If we think of one variable as an effect and of another as a partial 
cause, we may separate the variance of the effect into two portions, 
one of which is uncorrelated with that of the partial cause while the 
other is perfectly correlated with it. In particular, the variance 
of the effect may be separated into one part representing the variance 
of the observations about the regression line (and hence uncorrelated 
with the partial cause), and another part representing the variance 
of points on the regression line about the mean of the effect (hence, 
determined completely by the variance of the partial cause). 

Let 2» be the effect. 

12» that part of the effect determined by the partial cause. 

Xo.1 that part of the effect independent of the partial cause. 

x; the partial cause, all being measured from their respective 
means. 


Lo = 1X9 + Zo. 
701 = T29(429) 
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a Lito” + ZiXo(To.1) 





7m eV = 
170(170 + 70.1) Nico 
but 7,229.1) = 0 by definition, so 
199 
ro = (2) 


i) 
Stated verbally: The correlation between an effect and an assumed 
partial cause is equal to the ratio of that portion of the standard deviation 
of the effect which is determined by the partial cause to the total standard 
deviation of the effect. The former standard deviation may be found 
from the equation 
109 = boo 1 (3) 

where by: is the slope of the regression line of x» on 2. 

The residual standard deviation, oo, is the standard error of 
estimate. 


Oo? = 100" + 670.1, 
and from (2), 
2 2 
2 _— 190 190 
rou = - 2 ee (4) 
oo" 1009? + 070.1 


This equation (4) expresses the relation between the correlation 
coefficient and the proportions of the variance of the criterion which 
are respectively determined by, and independent of, that of the 
“independent” variable. Obviously, if 109 = 0, ro: = 0, and if 
Oo.1 = 0, To, = 1. 








he at 170” oo” — o*0.1 
~~ ae 2 
Jo Jo 
2 
O~o.1 
Tu = AE —_ “i (5) 
Jo 
070.1 = oo" - oor") 
0.1 = ooV 1 — 79, = koe 0 (6) 


Equation (6) is the ordinary formula for the standard error of 
estimate, and (5) is a formula relating the standard error of estimate 
and the standard deviation of the ‘“‘dependent”’ variable to the 
correlation between the ‘‘independent” and ‘“‘dependent”’ variables. 

In the case of linear regression, 179 may be determined directly 
from (3), and the correlation calculated from the ordinary product- 
moment formula, but if the regression is non-linear, equation (3) 
breaks down, and must be replaced by an equation involving higher 
powers of the variables, the nature of the equation depending on the 
form of the regression line. In this case the product-moment formula 
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breaks down also, as it is based essentially on the assumption of 
linearity of regression. However, equation (5) is not affected by the 
form of the regression line; hence it may be used to calculate the 
correlation when the regression is non-linear. The interpretation in 
terms of the analysis of variance by equation (4) still holds. The 
fitting of curved regression lines and the computation of the standard 
error of estimate and the index of correlation for such lines have been 
treated by Mills.1 He has pointed out that equation (5) describes 
the correlation between two variables no matter what the form of 
the regression line, the correlation coefficient representing the special 
case where this is a straight line fitted by the method of least squares, 
and the correlation ratio the special case where the line is arbitrarily 
made to pass through the means of the z»-arrays. The writers have 
not seen the interpretation in terms of the analysis of variance— 
equation (4)—pointed out except for the two special cases of the 
correlation coefficient and ratio. 

An important special case is that in which the partial cause con- 
tributes itself completely—.e., in which ,;2%) = cx, c being a constant. 
In this case, 


C071 
fo = —- (7) 
0 
. co? - c*o;? (8) 
ee Se eee ee ee ee 
oo" c*a;? a 70.1 
and 
‘ c*a3" 
Koy =l]- 2° 
v0 


If the units of measurement are assumed or made equal, c will 
equal unity. Under these conditions, 779; gives the proportion of 
oo” which is determined by o,? and ko; the proportion of oo? determined 
by residual factors. 

Tryon’ has pointed out that the above special case has in fact 
been assumed by many writers to be a general statement; but that 
the use of r? and k? as the ratios of the variance of the criterion deter- 
mined respectively by the “independent” variable and residual 
factors is only correct when the ‘‘independent”’ variable is known or 
assumed to contribute itself completely. The following analysis is 
adapted from Tryon. 

We have so far assumed that one variable was the effect and the 
other the partial cause. The correlation coefficient itself gives no 
clue as to which variable should be considered as causal, nor does it 
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determine entirely the extent to which the causal variable contributes. 
We have just considered the case where the latter contributes itself 
completely, and found that r? gives the proportion of its contribution. 
This relation holds whichever variable is assumed to be the causal 
one, and hence represents an important limiting case. The general 
case is the one in which the two variables under consideration are both 
affected by a common cause. Calling the variables correlated 20 
and 21, and the causal factor z2, we have, 


Lo = Cole + 20.2 Oo” = Coe” + 070.2 
Z1 = 1X2 + Lie O17 = Cy"o0” + 071.2 


Noting that ze, ro.2 and 21.2 are uncorrelated, 








CoC 1 LL” CoC 102” 9 
To1 = WN, = - . ( ) 
0001 001 
Also 
Cod 2 C102 
ros = —, and Ti2 = —J 
Jo 01 
so that 
CoCi02 
Tfee1g @ —————— ™ a1 (10) 
7001 


Formula (7) can be shown to be a special case of formula (9). 
If x, is determined completely by 22, 


Zi = Ciz2 
2%o = 120 
T0.2 = %o.1 


But from our definition in the general case, 
Lo = Cole + Xo.2, 
whence 
Cole = 2%o = 100. 
Now from the first of our special conditions, 


Lt2'= “ty 
so that 
1v%o = er’ 


and 
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(of formula (7)), and 


2 





01 
i 
o Se aun=6 
2 cs? 
Then substituting the value of o,? in (9), 
Co 
2 o1 
CoC10 71 Cy C01 
To = 9 => ———_- = - ) 
C1°O00 1 Jo ai) 


which is identical with formula (7). 

The other limiting special case is that in which the residual corre- 
lations in the two variables under consideration are equal. In this 
Case 72” = 112”, and from (10) 

Tor = Toe = 1749" (11) 

From (7) and (11) it is apparent that we can pass to the proposition 
that under these conditions ro; gives the proportion of oo? which is 
determined by o,’, or vice versa. Thus it is seen that the proportion 
of the variance of one variable determined by any other may always 
be represented by a fraction whose value lies somewhere between 
that of the correlation coefficient and its square. Methods for evaluat- 
ing this fraction have been discussed by Tryon. In applying these 
results to the estimation of the community of function between 
variables measured by fallible observations, it is necessary to use 
correlation coefficients corrected for attenuation. 

A common fallacy in computing correlations is the use of quotients 
involving the chronological age in the denominator as data. Such 
studies, involving correlations between intelligence quotients, etc., 
are all likely to suffer from spurious index correlation caused by the 
common variation of the chronological age in the paired observations. 
It should be noted that correlating such quotients does not result in 
eliminating mutual correlation with age, except in certain special cases. 


This matter was discussed in an early paper by Pearson? and in a later 
one by Thomson and Pintner.* 


IV. PARTIAL CORRELATION 


The use of partial correlation in the analysis of causation is beset 
with many pitfalls, as has been pointed out by Burks.®:® One of these 
is the attempt to argue directly from partial correlation to causation. 
Partial coefficients do not indicate the direction of causation any more 
than do total coefficients, or any other statistical measures of con- 
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comitant variation. All that such measures provide is an estimate 
of the magnitude of the relationship; never of the direction of causation. 

The partial correlation coefficient measures the correlation between 
that part of a variable which is uncorrelated with one or more others 
and that part of a second variable which is also uncorrelated with these 
others. It ‘eliminates’ not only the effects of the variable or variables 
partialed out upon the variables whose residual correlation is to be 
determined, but also any effects of the correlated variables upon those 
‘“eliminated.’”’ Hence, in general, the partial correlation coefficient 
is likely in most cases to eliminate more than is desired. An important 
exception is the case of chronological age. Obviously, this must 
always operate as a ‘‘cause’’ when used to represent maturity, and 
there are many cases in which it is desired to estimate the relationship 
between two traits both of which exhibit progressive development 
with age. If the only observations available are from groups hetero- 
geneous as to age, the partial correlation technique is appropriate. 

There is one special difficulty encountered in dealing with correla- 
tions between a variable such as a test score or a physical measurement 
and chronological age. This arises from the fact that the regressions 
are significantly curvilinear if the age range becomes at all large 
(more than one or two years). If the only reason for computing 
such coefficients is for use in “‘partialing out’? the chronological age, 
it is not necessary to fit curved regression lines and calculate indexes of 
correlation about them. Fisher’ has pointed out for the case of the 
time series, which is essentially similar, that the effect of time (in 
this case age) may be eliminated by partialing out time, its square, 
its cube, ete., treating these as separate variates. For most practical 
purposes, it is unnecessary to go beyond the cubes, and in a great 
many cases the squares.. 


V. SEMI-PARTIAL CORRELATION 


There arise many problems in the study of causation where it is 
desirable to know the correlation between that part of one variable 
which is uncorrelated with one or more others and another variable or 
that part of it which is uncorrelated with one or more others. The 
‘one or more others’? may or may not be entirely or partly the same 
in both cases. If they are entirely the same we have the case of 
Yule’s partial correlation.’ If they are partly or entirely different, 
we shall designate the coefficient as a semi-partial coefficient. An 
example of the use of semi-partial correlation might be the following: 
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Given the intelligence scores of a number of children, the intelli- 
gence scores of their parents, and a rating of the home environment 
(such as would be given by the Sims Socio-Economic Score Card). It 
is desired to know whether the home environment affects the child’s 
intelligence score more than is to be expected from a knowledge of the 
fact that the more intelligent parents are likely to provide the better 
homes. Now it is obvious that the parents’ intelligence will affect 
the home environment, and that the latter will probably affect 
the child’s intelligence score. We may assume that the effect of the 
child’s intelligence on the home environment will be negligible. The 
problem then reduces itself to estimating the correlation between 
that part of the home environment score which is uncorrelated with 
the parents’ intelligence score and the child’s intelligence score. The 
ordinary partial correlation between home environment and child’s 
intelligence with parents’ intelligence ‘‘ held constant’’ is not applicable 
because it represents the correlation between that part of home 
environment uncorrelated with parents’ intelligence and that part of 
child’s intelligence uncorrelated with parents’ intelligence. The semi- 
partial correlation appropriate to the solution of this problem will be 
designated r;.3)2, the correlation between that part of variable 1 
uncorrelated with 3, and all of 2. 

The following analysis represents an attempt to derive the principal 
systems of semi-partial correlation, of which Yule’s formula is one, 
and the above is the three-variable case of another. 





Let 
t1 MoD) 
21 = 5) 22 == ° 
01 02 
Then 
0, =O, = °*'* =o, =1 (12) 
- 2X 1L2 at 2 (21/01) (t2/o2) es 22122 
== Nojo2 7 N "7 N (13) 
Let 


0} 
01.2 = Zi — 112-72" 
v2 


21.2 represents a deviation (in the x;-dimension) from the regression 
line of x7; On x2 (assuming this regression to be linear). If we consider 
all the observations on any subject as coordinates 21, %2, %3, . . . In 
of a point in an n-dimensional continuum, then 2.2, 23, . . . 2, will 
represent the coordinates in an (n — 1)-dimensional continuum in which 
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the value given by the regression line of x; on x2 replaces the mean of 
z, as the origin of measurement of 2;.2 in the x:-dimension, and the 
v-dimension does not appear. Similarly 21.2;, 24, ...2,, will 
represent the coordinates in an (n — 2)-dimensional continuum in which 
the value given by the regression plane of x; on x2 and 2; is taken as the 
origin for 21.23 in the z;-dimension, and in general 21.23 . . . m, 
Lmn+ly Lm+2) - + + In (Where m < n) will represent the coordinates in an 
(n — m + 1)-dimensional continuum in which the value given by the 
(m — 1)-dimensional regression hyperplane is taken as the origin for 
21.23 - - - m in the 2;-dimension, and the dimensions numbered 2 to 
m inclusive do not appear.* 


(21 — rine ) 
1 * 2 —- (14) 
———— oo een 





Let 


71.2 C2 Z1 — Tie (15) ft 
a2. = — = SS = 
H2 oVl—re Vv i - T219 
r o- 22i.302-3 _ - 2(a1 — T1323) (Ze — 12323) 
(1.3) (2.3) N NV 1 - ea > Haat = Me 


_ 22122 — 1132Ze%3 — 12322123 + T1323 D23° 


NV1 —r ome riyV/1 — _ 793 














From (12) and (13), 
_ tie — Tuts — T13T23 + 113723 
(1.8) (2.3) V1 — r73°/1 — ro3 
r12 — Visl 3 


T(1.3)(2.3) = = 112.3 
V/1 - —_ TyV/1 - — - Ta 


This is Yule’s formula for the case of three variables. 
We shall in general put a z, with subscripts, for the ratio of an x 
with the same subscripts to its corresponding standard deviation. 





(16) 





* The writers are indebted to Dr. Harold Hotelling for assistance in this geo- 
metrical interpretation. 

+ This is not the same as the z;.. used by T. L. Kelley® (p. 284) in deriving the 
multiple regression equation. He takes as the unit of measurement the standard 
deviation of the criterion, so that 21.2 = 21.2/01 = Zz: — 11222, while in the present 
analysis, the standard error of estimate is the unit of measurement used, the 
regression line becoming the origin instead of the mean. 
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Then, 
913 
41.3 — 112.3-— 22.3 
P _ Sa 02.3 
— SS” 
71.23 F1.34>/1 — ries 
21.3 — 112.322.3 
As 8 ea (17) 
V1 — 112.3 
and it can be shown similarly that, 
Z1.34++ +m — 112.384 ++ + n@2.34-+- Hn 
Maia... |e eee " (18) 


V1 — T719.84---8 


Total correlation coefficients will be hereafter designated as rj., 
etc., as usual; partial coefficients ries, . . . » as suggested by Yule; 
and semi-partial coefficients 1(1.34)(2.56), ete., the two terms in paren- 
theses being the things correlated, and each representing that part 
of the variable before the dot which is uncorrelated with those after 
the dot. Thus the example here given should he read, “‘the correla- 
tion between that part of variable 1 uncorrelated with 3 and 4, and that 
part of variable 2 uncorrelated with 5 and 6.”’ In this notation, Yule’s 
partial coefficient would be written riig4 . . - nd(o34- + + nd: 

It may be noted that in the following derivations no attempt is 
made to indicate economical methods of computation. The formulas 
presented may indicate the method of building up semi-partials from 
others of the next lower order, but the selection of the particular 
coefficients of each order to use in order to perform the computations 
with the least possible number of arithmetical operations has not been 
investigated, nor has the matter of numerical checks been considered. 
The writers hope to deal with these matters in a later paper. 


System A—PARTIAL CORRELATION 


bite a 221.34 22.34 sa Z(Z1.4 — 113.4 23.4) (Z2.4 — 193.4 Z3.4) 
N NV 1 - ris 4V1 — 7793.4 
- 221.4 2.4 — 123.4221.4 23.4 — 113.4223.4 @2.4 + 113.4723.422"3.4 
NV 1 _ Pisavl — T7034 


112.4 — 123.4713.4 — 113.4723.4 - 113.4723. 4 


V1 ri34V1 = T93.4 





Y12.4 — 113.41 23.4 





7(1.34)(2.34) = eects MS Pees (19) 
V1 _ risaV1 — T7954 
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Yule’s formula in the four variable case. It is not necessary to derive 
any other special cases of partial correlation, so we shall pass directly 
to the general case. Yule’s ri2s4 . . . » is in our notation 


_ 221.34 oe + nO2.84e00n 
T(18.4 + + + n)(2.384-++ 2) = — a 


NV 1 — 7713.45... ivi at as 


ys 
== (221.45. - n22.45 6+ + mn — 123.45 «+» 21.45 + + onZ3.45 ~~ - 


D (21.45 sen — T18.45+-- 








n —~ T13.45---n 

>> + S542 x 

223.45 + + + n@2.45 2-2 en 718.46 « + + nY88.45 0 - « nal 8.46 ---a) 4 
(NV1 — T713.45... V1 — £7s5.46 2 a) 


_ 112.45++ + n — 123.45 + + + oP 13.45 +0 on — 113.456 +» n23.45--- n113.45 ++ + nl'23.45 +000 


V/1 — 7713.45... ivi — 17". <s ss 


es 8 ee ae 











T(1.84 +++ n)(2.84¢+-n) = — a ma Se 
V1 = 713.45 eee V1 _ 1703 45. +h 


This is the general case. It is interesting to note here that the coeffi- 
cients of each order are expressed in terms of those of the next lower 
order until finally we have the ordinary total coefficients. It should 
be noted further that in the following derivations the same general 
trend is found, except that coefficients are expressed in semi-partials 
as well as partials of the next lower order. 


System B 


The correlation between that part of variable 1 uncorrelated with 
3, and all of variable 2 may be derived as follows: 


221.322 on D(z; = T 1323) 22 7 22122 — 11322223 


To. = — ————— 
a ae NVi-r, NV1—rs 


T19 — 7137 
ra1.3)2 = A BOB (21)* 





For the case of four variables, 
L21.3422 — LD (Z1.4 — 11s.4 23.422 











T(1.342 = ————_ -* 
ie N . NV1 — 7713.4 
_ 221.422 — 13.42%. 422 
NV1 — 713.4 
T(1.4)2 — 1713.47(3.4)2 
Ta.342 = On ae (22) 
V1 — 7713.4 





* This special case has been derived by Franzen” by a slightly different method 
from the one given here. 
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In the general case, 


 Kesns..- te Bis -- +o Fe. - > Maes >> ah 
T1134 +--+ n2>= seal) eect n 2, 





NV1—?P isa. en 

Rs a n@2 — 113.4. + + nBese see oe 
NV 1 — rs. . sn 

(1.4 + © © mp2 —~ 113.4 + © © n(3.4 + © © 2 


V1 — 7713.4 cn eS @ 


This is the case where that part of variable 1 uncorrelated with n-2 
others is correlated with all of variable 2. 

















(1.384 + + + n)2 


(23) 


System C 


The correlation between that part of variable 1 which is uncorre- 
lated with variables 3 and 4 and that part of variable 2 which is 
uncorrelated with 3 may be derived as follows: 


r _ 2%1.34%2.3 Z (21.4 — 113.423.4) (22 — T2323) 
een N NV1 = ri3.4V1 — 123 


_ 11.492 ~~ 123%(1.4)3 — 113.4 7(3.4)2 + Tost 13.4 7(3.4)3 o4 
7(1.34)(2.3) = eS + hn cn lh tl (24) 


VI = ra — Fn 


Continuing to the case which is general for one variable, 











_ 221.34--- 022.3 _ Z(21.4.--n— 118.4. + n&s.4-- + n)(Z2—1 0323) 
T(1.84+ ++ n)(2.3) = — oo a —— ——— 


NV1 = Ppa. ee nV — Ps 





(1.84 ++ n)(2.3) > 


T (14+ ++ m)2—T237 (14+ + 3 —T13.4- ++ nT3.4-- + my 21237 13.4... nV(3.4+++n)3 (25) 
V1 a a ss nV 1 — Me 
This is the case of the correlation between that part of variable 1 
which is uncorrelated with 3, 4, etc. (to any number), and that part 
of 2 which is uncorrelated with 3. 


In the general case, where m<n, 








_ 22134... -n2234--2m 
71.84 + + + n)(2.384+++m) = ge — 


(21.4 Pie OR 113.4 a + or n) (22.4 . . 


| * a +m — 123.4... + m2.4--- a) 
NV 1 — 7713.4... av 1 ae Yee 


11.84 + + © n)(2.84 +++ m) = (ra. 0 0 on) (2.4 + © © m) 7123.4 - + + mM(1.4 + © oe n)(3.4- + om) 





718.4 2 0 on T(8.4+ 0 0 a(8.4 > + om) F118.4+ 0 ow 188.4- + om M8.4- +o al8.4--- m)) 
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This is the general case for the correlation between that part of variable 
1 which is uncorrelated with 3, 4, etc. (to any number); and that part 
of 2 which is uncorrelated with some but not all of these variables. 
In evaluating the formulas of System C we use total correlations and 
semi-partials of Systems A, B, and D. 








System D 
ha a = See 
N NV/1 ke 
_ 227 — ro L222 Sd — rye 
— NVI-Pe V1i—-re 
rao1 = V1 — rp (27) 


Formula (27) gives the correlation between that part of variable 1 
which is uncorrelated with variable 2 and all of 1. This, as one would 
expect, is Kelley’s k, the coefficient of alienation, or in terms of stand- 
ard scores the standard error of estimate. 























” _ 221.03-. + n21 _ Z(2i3... a= fisg.-.o8as.-- as 
(1.23 - - + n)l N NvV1 vs ais mF 
T(1.84- ++ nm)l ~~ 112.34--- nV(2.384-++ nl 
rae... 91 = sath 2 (28) 
V1 — rise... 
or 
T(1.23---n1 = V/1 -_ rr i293 oc en) (29) 


The coefficient in (29) is a multiple correlation coefficient. Formulas 
(28) and (29) give the correlation between that part of variable 1 
which is uncorrelated with variables 2, 3, etc. (to any number), and 
allof1. This special case is the general multiple alienation coefficient. 


Where m<n, 


a sg Rss 6 a 
VUl.2 ese m(12e ee m = 





“i 2 (21.3 . oon ™ 1T19.3.+-+ 228.3... n) (21.3... a ~~ T1928 +.- e%bass-a) 








NV1 = ring... nV 1 — ring. sem 
T1266 mee ee m) = (Tans. C3 sm) 712.8 6 ee mT © + nV(2.3 6m) 
— T1938... n 728+ ++ a8. +--+ m) 118.8 +++ 0 718.8 - ++ mM88--- a) 
(2.3...m)) + (fi — 712.3 oe8 av l — 7710.3... m) (30) 


This is the general case of the correlation between that part of variable 
1 which is uncorrelated with several others and that part of 1 which 
is uncorrelated with some but not all of these others. 
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System E 


221.3224 _ B(Z1 — 113 2s) (22 — T2424) 


7(1.3)(2.4) = = ————— = 
N NV 1 ~— rial — Yo4 


Tig — Ti4T24 — 113 723 + 113 T2474 
es ——e, —— (31)* 
V1 cardi wv 1 — F724 
In the general case where n is odd and m is even, odd and even 
subscripts designating different variables, 


y 
“21.35 + > . n©2.46 a . % _™ 


N 


(1.857 + © + n)(2.468 + + « m) = 


a 2 (21.57 osm — 113.57 ++ + n@3.57-- - n) (22.68 s+ sm — 124.68+++ m24.68-- - m) 


NV1 Pinas ers aad 704.68 - sem 





71.357 + «© « n)(2.468 © + + m = (1.1.57 © © « n)(2.68 © © © m) 
— 794.68 « + + ml(1.57 © «© «© n)(4.68 © © «© m) 
"113.57 + © © n¥°(3.57 + © © n)(2.68 + © © m) 


> Tisss s+ + al Bhee + + + weer s+ « whtB ee m)) 


(1 — rissz . . . nV 1 — reas. . . m) (32) 
System F 


The correlation between that part of variable 1 uncorrelated with 
variable 2, and all of 2, may be derived as follows: 


— 221.222 = L (21 Th, 1 122%2)Z2 - T12 — Ti2 
T1.2)2 = oe ne. x ke Oe 


NVi=riy V1 =r 
ri1.292 = O ; (33) 
Note that variable 1 may be extended to cover the case of a battery 
of observations weighted according to the multiple regression equation, 
so that the correlation between a criterion (in this case variable 2) 
and that part of the battery uncorrelated with the criterion becomes 


T({1345 + + « nj} .2de = 0 (34) 





* This special case has been derived by Frazen’® by a slightly different tech- 
nique. 
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_ Bei23 . . . nee 
(1.238 + + + nj2 ~ N 
— Dis. +n Tins... nbas . . + nde 
NvV 1 ae Tr 10.3 ae 
a 





- ne —~ 112.3 - - + wl(2.8 - - - 22 

711.23 2° + 3 ®# = pcan wees ~~ => 0 35 
— a afi — Pius... « ( ) 
The correlation between that part of variable 1 which is uncorre- 


lated with variable 3 and that part of variable 3 which is uncorrelated 
with variable 2 is derived as follows: 


ea 221.3%3.2 _ ZZ — 113%) (23 — reste) 
(1.3) (3.2) N NvV1 na ral — ee 
T13 — T1223 — 113 + T1317 93 
V1 ‘ie ryV/1 — 793 
oe T23(TisT23 — 112) 
ee ead ae. vie: 


The presence of correlation in this case may be explained by the 
analysis of variance. 








071.3 = 6713.2) + 77 1.(93) 
This may be read: ‘‘That part of the variance of variable 1 which is 
independent of variable 3 may be thought of as being composed of 
two portions: that part of the variance of 1 which is independent of 
the part of the variance of 3 which is independent of 2, and that part 
of the variance of 1 which is independent of the part of the variance of 3 
which is determined by 2.”’ The dot, as usual, signifies independence 
of succeeding variables; the previous subscript denotes dependence. 
Then from equation (2), 


71.(3.2) . 
T(1.3)(3.2) = —-—— > 0,ifo1..3.2) > 0, 


91.3 
1.¢., if variable 3 is not completely determined by 2. 


. _ Zei34. . - nh3.2 
(1.34 + + .« n)(3.2) ™ N pat 








i Ziti... - a — T.4-- - oa. - - ale — T2322) 
NV 1 ie) a nV 1 — 793 
M34 ee nd(3.e) = (Maa. sds — TasTa s+ + nde 
— 713.4 + + + nM(3.4 + + + n)8 


+ Tesfi3.4.. . nl(3.4 +++ n)2) + (V1 me ae nV 1 — r?93) (37) 
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In the general case, where n is odd and m is even, 


_ 221.35... nlsee ee om 
Tae ess ws ee ey) | paar 


— 221.57 ~~ nm — 113.57 + + + n23.57- + n) (23.46 - - « m — 732.46» - m22.46--- m) 


NV1— nan lee V1 - P5946 — . 7 











71.85 + + © n)(3.24--> +m = (r(1.57 * «+ © n)(3.46 + + + m) 
— 132.46 - - © mM(1.57 - + + n(2.46 © + © m) 
1713.57 + © © nM(3.57 + + © n)(3.46 + © + m) 
+ T13.57- + + nW°32.46 + + + ml(3.57 + + + n)(2.46-- - m)) 
> (V1 — £713.57. av l — T73946-. ~ ina (38) 


VI. MuLTIPpLE CORRELATION AND PATH COEFFICIENTS 


The essential problem of this section is to determine the ratio of 
the portion of the standard deviation of a criterion determined by one 
of the ‘“‘independent’”’ variables in a system to the total standard 
deviation of this criterion; or to determine the proportion of the total 
variance of the criterion (considered as an effect) ascribable to the 
‘‘independent”’ variable (considered as a cause). 

It has already been shown (Sec. III) that in the case of a criterion 
and one “‘independent”’ variable, the ratio of the part of the standard 
deviation of the criterion which is determined by its regression on the 
‘‘independent”’ variable to its total standard deviation is equal to 
the coefficient of correlation between the criterion and the ‘‘independ- 
ent’’ variable. The analogous coefficient, where there are other 
‘“‘independent”’ variables in the system, has been termed a path 
coefficient by Wright.'! The proportion of the variance of the 
criterion which is determined by its regression on one of the ‘‘independ- 
ent’’ variables has been designated by Wright as the coefficient of 
determination of the criterion by the given “independent” variable. 
The coefficient of determination is thus the square of the corresponding 
path coefficient, and, by the principle of the analysis of variance, the 
sum of all such coefficients must equal one, if the system includes all 
the causes of variation in the criterion. In any ordinary system the 
total variance of the criterion will not be determined completely by 
the ‘‘independent”’ variables. The ratio of the residual variance in 
the criterion to its total variance will equal the square of T. L. 
Kelley’s® (p. 288) multiple alienation coefficient; and the ratio of the 
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sum of all the portions of the variance of the criterion determined 
by the ‘‘independent”’ variables of the system to its total variance 
will equal the square of the multiple correlation coefficient. 

Let 2) be a criterion score (measured from the mean) and 2, 
2, . - » &, corresponding scores in the “independent” variables. 

If there is only one ‘‘independent”’ variable, 


To 
ifo = 1To1-Z1 
01 


(so that 1%) + 2.1 = 2), the pre-subscript indicating the ‘‘determin- 

ing” variable. We should read iz, as ‘‘that part of x) determined 

by its regression on z;.”’ All regressions are assumed to be linear. 
Similarly, it can be shown that 








T0(1.2)90 
1.2%0 = a nee 
1.2 , (39) 
To(2.1)%0 
we 
02.1 
and in general 
T0(1.23 - - + nO 
LS. ee 8 OC ee (40) 
O1.2%3+-++n 
where 
01.23 ~- ++ nm = 01,23... (in-yV 1 _ T7123 + + «© (n—1) 
1.23 - . +» n@o Should be read, the part of x, determined by its regression 


on the part of x; which is independent of xe, x3, and other ‘‘independ- 
ent” variables. Then 


00 
190 = 101-91 = T0190 (41) 
01 
_ T0(1.2)F001 
Qe 
01.2 
_ T0¢2.1)F02 
wa... 
02.1: 
T0(1.23 «+ + + n)\F0C1 
1.28 > 2s intQ = — < mceaee tat mas (42) 
01.93 - +e n 


Let 8o, be the path coefficient of the path from z, tox). Then by 
Wright’s definition, in a two variable system, 


Bou = 0 = To. (43) 


00 
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In a three variable system, 8o1.2 may be defined as Lee, 1.€., as the 
y oo 


ratio of the part of the standard deviation of x) determined by 2, alone 
to its total standard deviation. 
Then 


Jo 01.2 | 


1.290  -70(1.2)F1 


Bo1.2 


(44) 
_ 2.190 _ 102.102 
Boo.1 - 


do 02.1 





j 


Let do:.2 and doz, be the corresponding coefficients of determination, 
Then 





9 9 
d 2 77 9¢1.2)01" 
Mi 9 — i 
00 01.2 | (45) 
2 2 2 : 
d _ 2.190° _ 1° 0(2.1)%2 
—. ¥ = 2 a 
Ai) O°2.1 | 


and there will be a portion of the variance of x) determined jointly 
by z: and z2. Wright has shown that this 


doiz = 27 128o1.2802.1 (46) 


The sum of these coefficients of determination will be equal to 
the square of the multiple correlation coefficient. 
In a system consisting of a criterion and n “‘independent”’ variables, 














__ 1.23 + + + nO0 T0(1.23 - + + nO 
Boi... ., = ————- = - — 
00 Oi.mMecrs® 
2.134+ + + nF0 T0(2.134 + + + n)F2 - 
Bors... n = — = - ieee { (47) 
. oo 02.184 +++ n 
‘ _ 7.123 + + + (n—1)90 __—-F0(m.123 « + + (n—1))On 
Bon.123 - . « (n—1) = —— a ae serena 
v9 On.12+ ++ (n—1) } 
9 
do 1.23 een = Bors. en | 
. . (48) 
don. 12 see (n—-) = B*on.12 se + (n—D | 
Aoit.34- ~~ n = 2112B01,23 « « - nBor.13 ++ n (49) 


Qoijos---()--. (). 6m = 2riBore...()..- nBozis--- 
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where 7 takes any value from 1 to n, and j takes any value from 1 ton 
other then 7, there being ,C2 such terms. 
There will also be terms of the nature of 0123.45 - - - ny Qoiagi.s6 s+ ny 
-, jiz3¢-->G=v.n, in all possible combinations. In problems 
involving more than three variables, the computation of these terms 
becomes exceedingly laborious. They are ordinarily of little interest 
in the study of the causal relationships in such problems, and are not 
necessary for the computation of the multiple correlation coefficient, 
which can be obtained from the path coefficients (8o:.0;..., : 
Boris-++n, ete.,) and the intercorrelations. Their calculation has 
been discussed by Wright. 
From equations (44), 


Borg = Tene Tor = Toston Pon — 1 





(eed ee ed 
Boo. = a? on (Tos aa rowri2)o2 — 02 — Toitie 
02.1 24/1 — re 1 — Pave 1 — r*1. 
Similarly 
Bo1.23 = Ey -.. F0(1.23) _ — 101.3) — T12.37 02.3) _ 


13 VYl-reVl—rys V1—ra(1—re,) 


ee eat aaa © ieee 
Bos 1 — 7743 — Boo.sV 1 — 703 pi : im = 
ae snl V1 Ps T° 93 


(1 — rie3)V1 — rag 


— Bor. ~ Bor.2Be1.3 , 
a 1 — Be1.38 12.3 (52) 


In general, 
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: lL = Besse... afis.sa--> 0 


It may be seen from formula (53) that the path coefficient Boros; .. . » 
is identical with T. L. Kelley’s partial regression coefficient in the 
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special (standard score) form of the multiple regression equation,* 
Hence, in a system involving an effect and several ‘‘independent” 
causes, the path coefficients of the paths from all the causes to the 
effect may be obtained simultaneously from the least squares solution 
of the standard-score multiple regression equation. f 

EK. L. Kelly’? has pointed out that if one of the ‘‘independent” 
causes is itself the effect (in part) of other remote causes, we may set 
up this variable as a temporary criterion with the remote causes as 
the “independent” variables, and solve by means of the regression 
equation. Wright has shown that the path coefficient of the path 
from a remote cause to an effect is equal to the product of the path 
coefficient of the path from the remote cause to the immediate cause 
and that from the immediate cause to the effect, or to the sum of all 
such products, if the remote cause affects the effect through several 
immediate causes. He has also shown that if the causes do not 
combine by simple addition, but by multiplication or by more complex 


types of interaction, the path coefficients are still applicable as first 
approximations. 


VII. PARTIAL-MULTIPLE CORRELATION 


In combining several series of ‘‘independent’”’ observations for 
some specific purpose, it might be desirable to use as a criterion some 
partial function rather than a single variable. For example, we may 
desire to construct an educational test battery for the purpose of 
classifying pupils into groups on the basis of ability to do school work. 
The criterion group would necessarily be a sample of a wide range of 
school grades, the presumption being that those in the upper grades 
possessed the greater total ability. But school achievement is known 
to be a growing trait; hence our criterion should be that part of grade 
placement which is uncorrelated with chronological age, and each 
“independent” variable should be that part of the corresponding 
test score which is uncorrelated with chronological age. Since correla- 
tions with chronological age are known to be non-linear in large age 





* Kelley was undoubtedly aware of the significance of this function when he 
stated® (p. 285), ‘It (801.2) is the weight or multiplying factor of z; when 2; and 2: 
are both used to estimate 2p.”’ 

+ This fact was pointed out by E. L. Kelly’? in connection with a discussion of 
Garrett’s'* RB functions. Neither Garrett nor E. L. Kelly has noted that these 
RB functions are identical with T. L. Kelley’s 6-regression coefficients. 
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ranges, it would be necessary to eliminate the squares and possibly 
the cubes of this variable as well as its first powers. 

Let z) be the ‘‘dependent” variable (measured from the mean in 
terms of the standard deviation as a unit). 


Za, 2, etc., to Zp, the eliminated variables. 
21, 22, ete., to zn, the “‘independent”’ variables. 
Bi, Be, ete., to B,, the corresponding regression weights. 


(Then Bi = Bro. . ~~ pi(i.cd - + + p+ (2.0b + + + p8.ab+ s+ pee. 
(nab - - » p) in our former notation. The subscript 1 is sufficient to 
identify the 6 under consideration.) 

Then Za... , Will be the partial criterion. 2.4... », 
Zo.ab + + + py CtC., tO Zn.ab . . . p Will be the partial “‘independent”’ varia- 
bles. Zo.a - - + p Will be the best estimate of 29. ... » which can 
be made from a knowledge of the partial ‘‘independent”’ variables. 
The problem is then to determine (;, Bz, . . . 8, in such a manner 
that D(20.0 -- + p — 20.0... p)? Shall be a minimum.* 


Zo.0b + + + p = Bidiab. ~~ pt Botea.--p t*** + Brdnad--- p 


1 - 
Koa). - py ts sm = pp Dy (20.0 --- p — 20d -~ + 9)? 


1 
= yy (20.0 » -- » — Bits.cd - -.p —~ Bite. ---2—°°°—Bainad---»)* 


Differentiating with respect to 6:, and setting the first derivative 
equal to zero, 
2 
dy (20.0 +--+» — Bibr.cd«- +9 — Bata.d..- 9 —... — Babncd--- 9) 
(—Z.0---p) =0 
Differentiating with respect to each of the other 6’s and setting 
these derivatives equal to zero, 
2 
Ny (20.0 +» +p — Biti.ob +» p — Beta...» — *e4 ~ Bid. -s a) 


(— 22.0... p) =0 





* A solution of this problem by a method different from the one used here was 
given by Dr. Harold Hotelling in a paper entitled ‘‘ Mixed Multiple-partial Corre- 
lation,’ which he read at a meeting of the San Francisco section of the American 
Mathematical Society at Berkeley Cal., Oct. 31, 1925. This paper was never 
published, but a brief report was printed in the Bulletin of the American Mathe- 
matical Society, Vol. XXXII, p. 98 (1926). 
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2 (Zo.0--- 9 — Biti.ad..-» — Bsa... 9—°** — Balad...) 
N 


(— 2n.ab--- ») =0 


Multiplying by the second factor, summing, and expressing in 
terms of correlation, we have the following normal equations: 


foa.d+--9—~ Bb: ~ Bid +297 °** ~ Brie -.._ 20 
To2.ab ++ - p — Bilic.e *** p - §.— a ae ~ Bfen.d «++ =) 
Ton. «> - py — Bifin.ad.-.- 9 ~ Boloned---—p—°** — Ba = 0) 


(Equations 54) 


These equations may be solved simultaneously for the 6’s by the 
Doolittle method, the iteration method, or by determinants. It 
will be noted that these equations differ from those given by Kelley? 
(p. 295) for the ordinary multiple regression equation only in that 
the basic data are the partial correlation coefficients instead of the 
corresponding total correlations. The b-regression coefficients may be 
obtained from the relations, 


, 


O0.ab-e«+-s Go.ab « « « O0.ab-.+- side 
by = By . a i me be = Be a dat b,, = Br ws ® (55) 
O1.ab “2 * Dp O2.ab fas On.ab *** Dp 


The partial-multiple correlation coefficient is given by the formula 


Ton... ahead. - >» * (Bifeua--.-—9 + Bofad-.--et?**'+ 
1 ~ 
BaTon.ab es -]” (56) 


Tappan"™ has discussed other methods for computing the partial- 
multiple correlation coefficient, which shorten the labor of computa- 
tion when the regression coefficients are not required. Writing his 
equations in our notation, 


To(12 a n)+ab . + a 2 = {1 7" k701.93 © «© « nab«-« -» pk 00.34 oo «© Oa @ «¢ « p 
; ») taf 
= kon. ab cw eS ol’ (57) 


Kou... ab +++ p) a » 
rout ++ aab---9 = [1 = - (58) 
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VIII. Summary 


1. The application of all forms of correlation to the solution of 
the problems of causation rests for its interpretation on the principle 
of the analysis of variance. 

2. Partial correlation has been shown to be inadequate for solving 
most problems of causation. 

3. Several systems of semi-partial correlation have been developed 
to meet certain of these deficiencies. 

4. The relations of Wright’s path coefficients and coefficients of 
determination to the principle of the analysis of variance, the second 
system of semi-partial correlation and the standard score form of the 
multiple regression equation have been pointed out. 

5. A method for using a partial criterion and partial ‘“‘independent”’ 
variables in the multiple regression equation has been discussed. 

6. Other systems of semi-partial and semi-partial-multiple cor- 
relation could be devised to meet other needs. Those here presented 
were devised to aid in the solution of certain problems of psychology 
and education. 

The writers are indebted to Dr. Harold Hotelling of Stanford 
University for reading considerable portions of this paper and offering 
several valuable suggestions. 
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CIRCUMSTANTIALITY AS A FACTOR IN GUESSING ON 
TRUE-FALSE EXAMINATIONS 


INA HILL BRINKMEIER AND NOEL KEYS! 


University of California 


The present experiment was inspired by the writers’ convictions: 


1. That the amount of guessing which takes place in the average true-false 
examination is much greater than is commonly realized, even by those who are 
being examined; and 

2. That many of the statements in such examinations can be recognized as true 
from their form and nature, apart from any knowledge of the particular subject 
matter involved. 


The fact that certain words or phrases in true-false statements 
often serve as ‘‘specific determiners,” giving fairly dependable cues 
to the correct response has been noted by more than one writer. 
For example, an overwhelming proportion of statements containing 
the words all, always, only, no, never, and none will be false, while 
statements qualified by most, some, probably, may, often, and the like, 
are true. Similarly, statements containing specific citations or 
enumerations, such as “ was one of the ,’ are usually 
true, while statements containing a cause or reason clause are more 
frequently false. Pupils soon become aware of these peculiarities 
of true-false tests, and there is little doubt that much of the practice- 
effect which gives so distinct an advantage to the “‘test-wise’”’ pupil 
must be attributed to increasing sensitivity to cues of this sort. 

The present article, however, is not concerned with such cue words 
and phrases, but with certain far subtler indications of a more general 
description. As previously stated, the writers have felt that such 











1 The compilation of the self-evident statements of List 1 and the practical 
conduct of this experiment were the work of Mrs. Brinkmeier; the devising of the 
factitious List 2 and the preparation of the present article, the work of Mr. Keys. 

* Weidemann, C. C.: ‘‘How to Construct the True-false Examination.” New 
York: Teachers College, Columbia University, Contributions to Education, No. 
225, 1926. 

Lee, Baldwin: Some Faults Common in Informal Tests Made by High School 
Teachers. Educational Administration and Supervision, Vol. XIV, February, 
1928, pp. 105-113. 

Brinkmeier, I. H.: ‘‘The Technique of Constructing Objective Examinations.”’ 
University of California, Ph.D. Dissertation (unpublished), 1929. 
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indications are especially characteristic of true statements and that 
they are sufficient in themselves strongly to suggest the response 
“True,”’ quite apart from any accurate knowledge of the points at 
issue. 

In an attempt to secure more objective evidence of the existence and 
frequency of these indications, the writers obtained access, through 
the courtesy of Professors G. M. Ruch and G. A. Rice, to three hundred 
seventy-six objective examinations submitted in a nation-wide prize 
contest.1 These examinations, assembled from thirty-one states, 
covered all of the principal departments of high school instruction, 
although slightly more than half dealt with English and the social 
studies. They included a total of 10,756 true-false items. Inspection 
of these last convinced the writers that more than one-fifth of the 
statements were of such a nature that their truth or falsity might be 
correctly inferred by an intelligent and ‘‘test-wise’’ reader, regardless 
of his knowledge of the subjects.? After eliminating the false state- 
ments in this list and all true items containing one or more cue words 
or phrases of the specific-determiner variety above mentioned, there 
remained one hundred statements the truth of which might be regarded 
as to some extent self-evident. From this number a random sampling 
of fifty was drawn for purposes of the present experiment. 

An inspection of these fifty statements, as reproduced in List 1, 
following, will show that the characteristics which predispose one to the 
answer ‘‘True’”’ vary widely from case to case. Some, such as Nos. 
1 and 31, appear all but axiomatic. The student who would question 
the statement that ‘‘democracies need thinkers who will cooperate 
in the solution of problems,’ must be* obtuse indeed. Similarly, 
in No. 38 it requires no knowledge of ionization to agree that “the 
theory of ionization offers a reasonable explanation of many facts 
but is not accepted as true by everyone’’; the same might be said of 
almost any theory which one could name. 

The truth of certain other statements, while a trifle less obvious, 
might yet be safely inferred from the most elementary reasoning. 
Examples are Nos. 4, 6, 24, and 47. Still others, such as Nos. 3, 21, 
and 28, would be strongly calculated to evoke the response of ‘‘ True” 
on religious or patriotic grounds alone. 





1 Ruch, G. M., and Rice, G. A.: ‘‘Specimen Objective Examinations.” Scott, 
Foresman and Co., 1929. 
2 Brinkmeier, I. H.: Op. cit., Chaps. III and IV. 
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List 1.—Firty True STATEMENTS Founp In ActuaL EXAMINATIONS BUT 


—s 
. 


11. 


12. 


13. 


14. 


15. 
16. 


17. 


18. 


19, 


20. 


21. 


REGARDED AS LIKELY BY REASON or THEIR CrrncUMSTANTIAL NATURE 
to Be Markep “TrvuE”’ WHETHER KNOWN TO THE PupPIL oR Nor. 
ArTer Eacu StTaTEMENT Is SHOWN THE PER CENT or “TRUB”’ 
RESPONSES RECEIVED FROM ONE HuNDRED E1cuty HiGH 
ScHOOL AND UNIVERSITY STUDENTS PER 
CENT 
Democracies need thinkers who will cooperate in the solution of problems 98.9 
The movement of the earth around the sun, combined with the inclina- 
tion of the earth’s axis, gives us the seasons....................... 97.2 


. Tennyson believed that a sinful man might still be a victor by over- 


ee Ge eh Ge is 5s yb d-4.5G-e nb bes bed cede ee 96.1 
Only when we deal with civil problems in the light of intelligence and 

understanding after investigation, can we hope for government in the 

ES Pn a Ee mE Ay one ES) 95.0 


. Slavery was such a vital question that it served as an incentive to literary 


ESET ge Ere oe Ae i ae ee aE Bae BE DS 92.8 
The adventures of the great Elizabethan seamen fired the imagination of 

gos onc cess tnesbeacews debe eiwhwaae 90.6 
The shortage of iodine in drinking water is a contributing cause of goitre 90.6 
Early in life, Scott became interested in legends and in ruins of historical 


Abraham Lincoln’s prose style shows a close acquaintance with the Bible 90.0 


. Southern writers by means of dialect and other touches of local color pro- 


es ck wesaeeehesduawe seb adevverebews 88.9 
Radium, in spite of the fact that it is continually decomposing, is con- 

il is ae sa eikonal ae X0'5:6 ad 4 eben Fede tes 88.9 
Lamb’s life was filled with tragedy and poverty, yet he enjoyed much that 


ee an an ee 88.3 


“The Lady of the Lake” gives us many legends and quaint Highland 
At Le ee BeBe iy woh dw ews a ood 6 os ence she's 8 0e wae 87.8 

In the early period of our nation, laborers were too few and capital too 
scanty to exploit the wealth of our raw materials.................. 85.8 

The story of Beowulf lets us know something of the Anglo-Saxon ideals 85.5 


ee ia EE ee end Fé Said oes eae ae ee Khe ea eee 84.4 
Whittier has made the snows and the bees of his New England home 
RE a ee rere ee eee ree er rs ee 83.3 
The ‘‘de Coverley Papers’’ reveal the English dress, manners, customs, 
tasks, and social, religious, and. political beliefs of the early eighteenth 
RESO a Se ee nS ee ee cee ees sy 83.3 
The freed slave had civil and political rights in the United States more 
than a generation before the women..................eeeeeeeeeeee 82.7 
Representative government in England developed as a result of great 
charters of liberties which the kings were forced to grant............ 82.1 
The Declaration of Independence states the belief that governments are 
instituted to secure the inalienable rights of man................... 81.1 
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22. 


23. 


24. 


25. 


26. 


27. 


28. 


29. 


30. 


dl. 


32. 


33. 


34. 


35. 


36. 


37. 
38. 
39. 
40. 
41. 


42. 
43. 


With the close of the French and Indian War there came a distinct 
change in the behavior of England toward the colonies............. 
Lowell, who has been regarded at home and abroad as a representative of 
the best American life and letters, stands for the power of literature to 
influence the thought and life of a nation......................... 
The rugged, inaccessible country of the Lake Katrine region prevented 
the Lowlanders from retaliating upon the plundering Highland clans. 
Page’s books dealing with stories of the Negroes and plantation days 
i OE IU oa sis nc dc iu en eee ccsvececrsasdees 
Aged persons and children are peculiarly susceptible to the respiratory 
eee ee eS 8 oe ba ae od ka Sata ks eee DNs 
The supporters of Hamilton’s measures were a small minority of the total 
population, but common interests bound them in a compact, alert 
body, which enabled them to control the government. . pater 
Throughout our Constitution runs the same high idealism | concerning 
human equality as is announced in the Declaration of Independence 
Sewall’s diary portrays a vivid picture of the colonial life of his time. . 
In America, the group of western writers of the nineteenth century each 
had an unusual development of humor, democratic spirit, and a desire 
to present elemental facts of life... 2.0... cc ccc ccc ce cence 
It is impossible to say in what proportion the motives of political protest, 
commercial adventure, economic pressure, and religious dissent were 
mixed in the emigrants of the seventeenth century................. 
The first quarter of the nineteenth century saw the beginnings of a true 
literature in the department of poetry, fiction, and belles-lettres. .... 
The Colonial literary productions were impelled by the practical issues of 
the politics or theology of the time... ...............ccc cece ceeee 
In Virginia the growing of tobacco led to the occupation of large tracts of 
land and made impossible the establishment of the town with its local 
democratic features of meeting house and public school. . 
The Jacksonian era saw the introduction of steam locomotion, veforme i in 
criminal codes, in the curricula of schools, and in the organization of 
Modern industrialism makes nations so interdependent that if the pros- 
perity of one is injured from any cause, that of the others suffers in 
ee Si i ee ds ll wr i ua hci eRe ae Pe Ae Aas 
Johnson was a great scholar and the most important member of the 
i i i ie Mae ee 
The theory of ionization offers a reasonable explanation of many facts, 
but is not accepted as true by every one......................000- 
Goldsmith’s father was the model for the parson in the ‘‘ Vicar of Wake- 


The Renaissance aroused curiosity in the minds of the people of the 
EA EAE I Pe eae Ne nn es ee 
The early playhouses were built outside the walls of London 


“eee ee wee wewe 


The value of the Erie Canal is not to be measured in tons actually carried 
Samuel Richardson’s early training as a novelist was gained through 
writing model love-letters for young ladies 


2 oe ee ee ee ee ee et oe ee ee ee ee oe oe ee 


80.4 


80.0 


80.0 


78.9 


.. 48.3 


77.2 


. 76.5 


76.1 


74.4 


74.0 


73.3 


73.2 
72.6 
71.7 
71.5 
70.6 


70. 
68.3 


i) 





49 


50 


ee, ee eee 


TH 








True-false Examinations 685 


44. The word ‘“‘pageant”’ was first used to mean the platform upon which 


I sn trb de ewes acevesecsccceveceeiosnedcbecens 66.1 
45. The history of the United States furnishes us with many examples of the 

peaceful settlement of international disputes....................... 65.6 
46. English aristocrats and authors of the Augustan period frequented coffee 

Same ans ci By EWG ats 4d 0:6 6 5 Wisk ae 4.4 2.66 bb DEAN Ree baN EOE eS 65.6 
47. The coming of the printing press led to the waning of folk-ballads..... . 62.2 
48. Coleridge was interested in a communistic colony to be established in 

Sg AI ES RS a Sa ne ee re eet ete 56.7 
49. The “Bachelor” of the ‘‘de Coverley Club” belonged to the Inner Tem- 

ple, one of the most prominent lawyers’ societies................... 56.4 
50. One hundred years before the opening of Oklahoma for settlement, 

George Washington was inaugurated president..................... 56.1 


The majority of items in the list cannot, however, be so readily 
dismissed. The quality which they have most in common is perhaps 
best described as a certain circumstantiality of content and phrasing. 
The details are simply not the sort that a test-maker would be expected 
to invent. As one graduate student remarked when asked why he 
had marked statements sixteen and seventeen true although professing 
a total ignorance of Whittier, “‘If those statements were not true, 
they would not be in the test.” 

This holds true particularly of certain long statements in the list. 
As the writers expect to show elsewhere, there is a strong presumption 
that the longer statements in a true-false examination will be true 
ones. And when length takes the form of a cataloging of details, 
asin Nos. 18, 30, and 35, this presumption becomes all but a certainty. 
Such statements bear the stamp of the textbook all too plainly upon 
them. In them the testmaker appears to have abandoned the examin- 
ing function for the didactic. 

In order to obtain light upon the extent to which responses of 
“True”? made to the above fifty items were based upon knowledge 
or understanding, the present writers prepared a second list of twenty- 
five statements of their own construction. These statements are 
reproduced in List 2, below. The items in this list are modeled closely 
upon statements chosen from List 1. The parallelism of statement A 
with statement 17, for example, will be at once apparent, as will the 
resemblance of D to 7, G to 50, J to 37, K and O to 20, L to 41, Q to 29, 
R to 18, S to 16, T to 4, W to 44, X to 39, and Y to 35, to mention 
but a few. 

In each case, however, there is the striking difference that, whereas 
statements in List 1 are true, those of List 2 are false. The fifteen 
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items A to O inclusive range from the specious plausibilities of Riley’s 
poem on ‘‘The Old Back Fence”’ (item A), and the deplorable short- 
comings of a grass diet (item D), to such gross absurdities as the 
exploits of the Roman general, Cerberus, at Marathon (item I) or 
the choral arrangement of the Canterbury Tales (item E). All, 
however, share the common characteristic that they would assuredly be 
branded as false by one fully cognizant of the facts. 


List 2.—TWENTy-FIVE Factitious STATEMENTS, FALSE OR REFERRING 
TO IMAGINARY PERSONS OR CIRCUMSTANCES BUT PHRASED WITH A 
CIRCUMSTANTIALITY SIMILAR TO THE Firry TRUE STATEMENTS OF 
List 1, TOGETHER WITH THE PER CENT or HiGH ScHOOL AND 
UNIvERsITY STUDENTS Repiyine “TrRvuE”’ To Eacu Per 
CENT 
Riley has made famous ‘‘The Old Back Fence”’ of his boyhood home. 86.1 
The Antipodes are islands in the South Seas visited by Charles Darwin 
while collecting material for his ‘‘ Origin of Species.”’ yes .. 80.6 
The combination of southern tradition with frontier life in ‘the blue- 
grass region of Kentucky gave rise to a new and characteristically 
RE a 77.7 
The lack of calcium in hay and grass causes the hoof-and-mouth disease. 66.7 
‘The Canterbury Tales”’ were among the first English poems to be set 
eee ee eRe NG cee oie ines aaa ehh eee sada e 4 62.8 
Browning’s best poetry was written in iambic hexameter. . aii Te * 
Caesar was crowned Emperor of the Holy Roman Empire two hundred 
SERINE MEP TE TOS sc vice ca vccgivccaeeasivccesencevecs 55.6 
The addition of soluble aconite to a sodium or potassium salt produces a 
compound which acts as a powerful heart stimulant................ 53.7 
Cerberus demonstrated his ability as a Roman general in the battle of 
i iia ar aaa ee Raha katie eit aie a keh a bebelats ae San ee 43.9 
Samuel Endicott wrote the first literary work to receive country-wide 
gsi sess an ie Kge es abs ce paveebes ease tame’ 42.2 
The Renaissance was a result of the establishment of reformed churches 
i iy 5 ond eh d's Cae wae Ape n bm wo bank oe 37.8 
The Miracle plays were first produced before the Custom House in 
Ee ee rare ee eer er rr ee ren ene re ie 36.7 
In the American colonies highway robbers were oiashitead less severely 
than officials who embezzled public funds......................... 31.1 
The quarrel between Clay and Webster was fanned by the dislike of 
RE ee re ee ee eee 27.8 
Women secured the right to vote in the United States as a result of the 
oes Ga sd haa RL Ok suka wire Sue Oi ek be Ok oe ce aL as 25.7 
Before marriage the Scotch lassies of whom Burns wrote were accus- 
tomed, instead of an engagement ring, to wear around the neck a 
bright ribbon known as a “‘curchie.”’ 
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Q. Thomas Burnham’s accurate pictures of life were founded upon experi- 
ences and observations of human nature made in the course of his 


oa A Ae ks awk 66 6-4.4.0:6.4:4:6.00 44 de whee eek ERT 84.8 
R. ‘The Long Trail” paints a glowing picture of the courage and endurance 

of the men of ‘‘covered wagon” days.................... 0000 e0 eee 77.8 
S. Marston’s quiet country life is reflected in his literary efforts.......... 74.4 
T. The education of the masses to appreciate the philosophy of idealism 

should lead to the elimination of disputes between capital and labor. . 67.2 
U. The sensitive nature of Shelley was moved to indignation by the revela- 

tion of the horrors of the African Slave trade...................... 66.7 
Vv. A cure for the stomach complaint known as gastritis has recently been 

discovered by the French physician, Bourdier..................... 65.5 
W. The brascombe was a type of short-sword worn by tragedians in the time 

eRe bo eae cei oad het Lb wend oad eedeneee et 61.7 
X. Shakespeare’s step-brother was the original and counterpart of Iago in 

ee le ie kno sin ait e's aid ah o kd hank wie Aawle hoa eed 59.4 


Y. Under the rule of Sylvester villages grew apace, domestic animals multi- 
plied, and there were even the beginnings of simple mining operations 
ie SD Oe SA IN SII. 5 oss n 5 i ccc ccc cccvcaceccccneess 57.6 


The ten items P to Y differ slightly from the foregoing in that either 
the persons or the circumstances described are fictitious. One would 
search in vain for the literary productions of ‘‘ Marston”’ or ‘‘ Thomas 
Burnham”’; history does not record the administration of the Hoover- 
izing Sylvester; Shakespeare had no step-brother; the ‘“‘brascombe”’ 
is found in no dictionary; and the charming custom of the Scotch 
lassies of statement P exists only in the imagination of the present 
experimenters. Only in the reference to Shelley is there the shadow 
of a likelihood, and this finds no substantiation in his biographies. 
Accordingly, whereas items A to O are clearly false, it is equally clear 
that items P to Y cannot be true. Of all alike, it may be said that 
they are marked by the same circumstantiality of form and content 
which characterizes statements of List 1. 

In preparation for the present experiment the fifty items of List 1 
and the twenty-five of List 2 were thrown together. To offset in part 
the preponderance of obviously true statements, the experimenters 
next selected from the examinations submitted in the Ruch-Rice 
contest twenty-five additional items regarded as obviously false. 
Typical of these last were such statements as: “‘ Daniel Boone was one 
of.our presidents”’; ‘‘High winds help to extinguish forest fires”; and 
“Hatcheries are built to destroy fish.” The entire one hundred items 
were then intermingled in chance order and mimeographed under 
the title of a ‘“‘General Information Test.” 
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This test was submitted to three classes of tenth, eleventh, and 
twelfth grade pupils at the University High School, Oakland, Cali- 
fornia, and to a group of one hundred senior and graduate students 
in the Department of Education at the University of California. 
The students were instructed both orally and by printed directions 
that some of the statements in the list were true and some false, but 
that the number of true and of false statements did not necessarily 
balance. Each statement was, therefore, to be marked true or false 
on its own merits. In case the student did not know the answer 
to a given statement he was instructed to guess, but any answer in 
which guessing was necessary was to be indicated by a question mark 
placed after the plus or minus sign. The importance of this was 
emphasized. Students were also assured that their answers would in no 
way affect their class marks. Believing the test to be a genuine infor- 
mation test, the students entered into it with zest, and to all appear- 
ances gave it their best attention and efforts. Twenty-five minutes 
was allowed for marking the statements, which proved ample for 
practically all members. After discarding the papers of those who 
failed to follow the directions and the few who did not finish, there 
remained a total of ninety-four papers from the high school and 
eighty-six from the university group. 

The responses to each of the one hundred test items were then 
tallied separately, according to whether the statement was marked 
true or false, and whether guessing had been indicated by a question 
mark. Results from the high school and university groups were 
also separately computed. 

In List 1 will be seen the fifty statements selected as more or less 
self-evidently true, arranged in descending order of the frequency of 
‘“True”’ replies received from the two groups combined. It will be 
noted that each of the fifty statements received a clear majority of 
‘“‘Trues,’’ while in all but the last seven cases the proportion of ‘‘ Trues” 
to ‘‘Falses’’ was more than two to one. | 

Considerations of space forbid including here the complete returns 
for each of the fifty items, but the summary may be seen in Table I, 
following. As might be expected, nearly four out of five of the total 
replies were ‘‘True”’ and approximately two times out of three this 
assertion was made with confidence. Of the items marked known, 
81.2 per cent of the total replies were ‘“‘True.’”’ While this proportion 
was naturally somewhat higher among the university group than 
among the high school students, it was very similar in both. 
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TaBLE I.—RESPONSES OF NINETY-FOUR HiGH ScHoot AND E1Guty-stx UNIVERSITY 
SrupENTs TO Firry TrueE-Fause ITeMs AcTtuaLLy TrvuE ButT CONSIDERED 
LIKELY BY REASON OF THEIR CIRCUMSTANTIAL NATURE TO BE MARKED 
‘“‘TruE” WHETHER KNOWN TO THE STUDENT oR Nort 














| Items marked | Items marked | Total ked! 
Group known tobe | guessed to be | ee are 
tested : 
True False True ‘False | True False 
High school.......... | 2696 713 916 370 3612 1083 
University............| 2967 596 497 231 3464 827 
er 5663 1309 1413 601 7076 1910 
PR Si se arenee 63.0 14.6 15.7 6.7 78.7 21.3 























1 In fourteen instances an item was left unmarked, which accounts for the fail- 
ure of the totals to amount to 9000. 


For our purposes, however, interest centers chiefly in the fact that 
among the answers frankly marked as guessed, the proportion of 
“Trues”’ was only slightly lower. Seventy per cent of the ‘‘guessed”’ 
replies were in the affirmative, and the high school group proved 
even more successful than the university. What was true of the 
totals held true to a remarkable extent of the individual statements 
as well. In the case of only one item among the fifty (No. 4) did more 
persons guess false than true. 

We have, then, the striking fact that students who believe that they 
know the answer to these statements are right only eighty-one per cent 
of the time, while those who admit they are guessing are correct in seventy 
per cent. Such figures go far to substantiate the impression that 
statements of the type of List 1 bear too many surface indications 
of the reply expected, and are poorly adapted to distinguish between 
the well-informed and the merely shrewd pupil. 

The objection may be raised, however, that the preponderance 
of true replies is not due to the nature of these statements, but to the 
fact that they are indeed true. There are many shades of knowledge, 
and it is altogether probable that many answers marked as guessed 
are in reality based upon vague or unconscious recollection of the 
facts. 

It is at this point that the false statements of List 2 provide a most 
valuable check. It will be remembered that, quite apart from the 
fact that these statements are really false, the dice were to some extent 
loaded against their being marked true. Of the other seventy-five state- 
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TaBLeE II.—ReEsponses oF ONE HunprRED Ercuty HiaH ScHoou anv UNtversity 
STUDENTs TO TWENTY-FIVE Factitious TrRUE-FALSE STATEMENTS ACTUALLY 
FALSE OR REFERRING TO IMAGINARY PERSONS OR CIRCUMSTANCES BUT 
PHRASED WITH A CIRCUMSTANTIALITY SIMILAR TO THE Firty TrusE 
STATEMENTS OF TABLE I 


The Fifteen Statements A to O Inclusive Are Easily Recognizable as Contrary 












































to Fact. The Ten Statements P to Y Are Concocted of Fictitious Persons or 
Imaginary Circumstances 
Times marked | Times marked | Total times 
known tobe | guessed to be | marked! 
Item Latha: Saws hae ee ee: 
True False | True | False | True | False 
—— —__—. 
A 98 2) 13 155 25 
B 88 22 57 13 145 35 
C 109 33 30 7 139 40 
D 54 24 | 66 36 120 60 
E 79 53 34 14 113 67 
F 49 35 62 34 111 69 
G 42 58 58 22 100 80 
H 23 22 72 62 95 84 
I 27 68 52 33 79 101 
J 36 44 40 60 76 104 
K 46 107 22 5 68 112 
L 30 80 | 36 34 66 114 
M 35 94 21 30 56 124 
N 17 81 33 49 50 130 
O 40 131 | 6 2 46 133 
Total A-O...... 773 | 864 | 646 414 1419 1278 
P 75 10 | 84 il 159 21 
Q 68 ». 4 83 21 151 27 
R 77 21 63 19 140 40 
S 49 14 85 32 134 46 
= 109 48 12 10 121 58 
U 87 38 33 22 120 60 
V 27 35 91 27 118 62 
WwW 34 17 77 52 111 69 
xX 42 33 65 40 107 73 
z 36 39 65 37 101 76 
Total P-Y...... 604 261 658 | 271 | 1262 532 








— 





1For several statements the number of true and false replies does not total 
one hundred eighty. This is due to the fact that in nine cases a statement was 
left unmarked. 
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ments in the test, fifty are true and but twenty-five false. Subjects 
as ‘‘test-wise’’ as the group here concerned are accustomed to find 
approximately one-half the statements in a true-false examination 
false, and to take account of this fact in making their replies. It is 
altogether probable, therefore, that, despite directions to the contrary, 
many would approach the statements from List 2 with the attitude 
of suspecting them to be false unless known to be otherwise. Not- 
withstanding this twofold handicap, we find from Tables II and III 
that in the total replies to these false statements, the ‘“‘ Trues’’ outnumbered 
the ‘‘Falses” by approximately three to two. 


TasLeE III.—ResponsEes or NINETy-FouR Hicn ScHoot anp EIGHTY-sIx 
UNIVERSITY STUDENTS TO TWENTY-FIVE FacTITIOUS TRUE-FALSE STATEMENTS 
AcTUALLY FALSE OR REFERRING TO IMAGINARY PERSONS OR CIRCUMSTANCES 
BUT PHRASED WITH A CIRCUMSTANTIALITY SIMILAR TO THE Firry TRUE 
STATEMENTS OF LisT 1 


The Fifteen Statements A to O Are Recognizably Contrary to Fact. The Ten 
Statements P to Y Are Concocted of Fictitious Persons or Imaginary 





























Circumstances 
Items marked Items marked Total items 
known to be guessed to be marked 
True False True | False True False 
Items A—O (15): 
High school......... | 451 376 396 184 847 560 
University.......... | 322 488 250 230 572 718 
) | a | 773 864 646 414 1419 1278 
POR vo ckcccewes | 28.7 32.0 23.9 15.4 52.6 47.4 
Items P-Y (10): 
High school......... | 343 121 364 111 707 232 
University......... .| 261 140 294 160 555 300 
» Ree | 604 | 261 658 271 1262 532 
Per cent. Pas sak einai ark | 33.7 14.6 36.6 15.1 70.3 29.7 
Total A-Y (25)........ | 1377 1125 | 1304 685 | 2681 1810 
| RES eS | 30.7} 25.1} 29.0] 15.2 | 59.7] 40.3 














More detailed inspection of Table II reveals the following facts: 


1. Of the fifteen definitely false items A to O inclusive, eight are marked “True” 


more often than “False.’’ In all, the ‘‘True” replies outnumber the “False” 
by eleven per cent. 
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2. Considering only the replies at which the subjects admitted they were 
guessing, twelve of the fifteen, or eighty per cent of the statements, are marked 
“True” more often than “ False.” 

3. To the ten fictitious assertions P to Y, the ‘‘True”’ responses outnumber the 
**False”’ in every case by from thirty-three to six hundred fifty per cent. 

4. Considering only the replies given as known without guessing, the ‘‘True” 
responses outnumber the ‘‘ False” for eight out of the ten statements. 


From Table III we derive the additional facts: 


1. To the false items A to O, sixty per cent of the high school pupils and more 
than forty-four per cent of the university students replied ‘‘True.”’ 

2. Of the 1419 “‘True” responses made to these fifteen items, seven hundred 
seventy-three, or a clear majority, give no indication of guessing. With regard 
to particular items, forty per cent of all the high school and fifty per cent of the 
university group were prepared to mark as a fact which they knew without guessing 
that ‘“‘the Antipodes are islands in the South Seas which were visited by Darwin 
while collecting material for his ‘Origin of Species.’’’ Sixty-two per cent of all 
the high school and sixty per cent of all the university students were equally 
certain that Kentucky was the birthplace of a new and characteristically American 
form of literature, while fifty-two per cent of the high school and thirty-four per 
cent of the total university group ‘‘knew”’ that the ‘“‘Canterbury Tales”’ were 
early set to music. 

3. Of the replies to items A to O marked as guessed, the ‘‘True’”’ responses 
outnumber the “‘ False” by fifty-six per cent. 

4. To the wholly imaginary assertions of items P to Y, the ‘‘True”’ responses 
are to the ‘‘ False”’ in the ratio of seven to three, and nearly half of these replies 
are given without indication of guessing. Even the university group rated these 
statements ‘“‘True’”’ five hundred fifty-five times as compared with only three 
hundred times ‘‘ False.” 

5. The proportion of ‘‘True”’ to ‘‘False’’ responses in the case of these last 
ten items averages about the same for answers given as known as for those marked 
as guessed. For example, eighty-eight per cent marked item P as describing a 
genuine Scotch custom, while reference to Table II shows that almost one-half 
of that number gave no indication of guessing. 

6. Although it is extremely unlikely that any considerable number of persons 
taking this test had any accurate knowledge of either the truth or falsity of these 
ten fanciful assertions, yet forty-nine per cent of the high school and forty-seven 
per cent of the university students marked them as true or false without indication 
of guessing. 

7. While superior knowledge enabled the university students to excel the high 
school pupils in the number of statements recognized as false, the general effect 
of circumstantiality of form in suggesting the response of ‘‘True”’ was evidently 
much the same for both groups. This appears most clearly in connection with 
items P to Y. 
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CONCLUSIONS 


1. Guesswork is so universal and habitual in connection with the 
answering of true-false examinations that high school and university 
students are alike unable to distinguish which of their answers are 
founded upon actual information and which are merely the result of 
impressions gathered from the general nature and appearance of the 
statements. To twenty-five false but circumstantial statements, 
more than fifty-five per cent of the answers given as known without 
guessing were wrong. Any system of evaluating test results which 
expects pupils to distinguish between answers known and those merely 
guessed at is, therefore, likely to prove unsound. 

2. Answers given as known are somewhat, but only moderately, 
more likely to be correct than are those indicated as the result of 
guessing. In the present study seventy-two per cent of the former 
were correct as compared with fifty-two per cent of the latter. (These 
figures apply to the seventy-five statements combined, and are 
obtained by pooling the totals of Tables I and III.) 

3. Statements marked by the circumstantiality of content and 
phrasing which characterize Lists 1 and 2 are usually true and are apt 
to be recognized as such by students, even in the absence of any real 
knowledge of the facts. Of the 4003 cases in which students admitted 
they were guessing, seventy per cent of the answers to the true state- 
ments and sixty-six per cent of the answers to the false statements 
were marked ‘‘ True.”’ 

4. Statements as obviously true as those of List 1 add little to the 
value of the test, since they do not discriminate successfully between 
the pupil who is well-informed and the one who is merely test-wise or 
shrewd at recognizing surface indications in the statements themselves. 
The chances are almost as great that these will be answered correctly 
by guesswork as by knowledge. In the present study, students who 
felt that they really knew the answers to the fifty true statements 
were right in only eighty-one per cent of the cases, whereas those 
who admitted they were guessing were correct in seventy per cent. 

5. It follows that, in addition to being careful in the use of cue 
words or phrases which act as “specific determiners” of pupils’ 
responses, test-makers will do well to scrutinize their true statements 
to make sure that these are not such as to be self-evident, merely by 
reason of their circumstantiality. Experience shows that it is difficult 
to invent comparable false statements after the fashion of List 2 to 
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offset circumstantial true statements of the type of List 1. Moreover, 
the positive suggestion effect conveyed by these false and fancifyl 
assertions is evidently so strong that it would probably be pedagogi- 
cally unwise to introduce many such into a test. Rather it would 
seem best to eliminate as far as possible the types of true statements 
which bear so many surface indications of their verity as to be of 
little value for purposes of measurement. 
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STUDIES IN HANDEDNESS: II. TESTING BIMANUAL 
HANDEDNESS 


R. H. OSEMANN 


State University of Iowa 


In the first article of this series a method of testing unimanual 
handedness was described. In this article the results obtained by 
administering several bimanual tests to a large unselected group of 
subjects will be described. The group used in this investigation was 
the same as that used in the investigation reported in the first article. 
In this investigation also the testing was done in a separate room where 
the subject was not disturbed by school activities. One pupil at a 
time was summoned and tested. 

The following four bimanual tests were used: 


1. Sweeping Test.—The subject was given a full-sized broom and his attention 
was directed to several small blocks of wood (dimensions 4" x 4" X 34’’) placed 
in a semicircle about four feet away from a fifteen-inch circle drawn on the floor. 
He was then told to sweep the blocks into the circle, moving about as much as he 
wished. A record was made of the hand which rested lower on the broom during 
the sweeping and of the side of the body on which the broom was used. 

2. Raking Test.—The subject was given a full-sized rake and asked to rake the 
several crumpled leaves of paper which were scattered about on the floor into a 
fifteen-inch circle drawn on the floor. He was told that he could move about as 
much as he wished. A record was made of the hand which rested lower on the 
rake and of the side of the body on which the rake was used. 

3. Shoveling Test.—The subject was provided with a light shovel and told to 
“scoop” the paper leaves he had raked together into a box which stood nearby. A 
record was made of the hand which rested lower on the shovel and of the side of 
the body on which the shovel was used. 

4. Batting Test.—S was provided with a ball-bat and told to stand about four 
yards from the experimenter. £E directed S to bat the ball which EZ tossed to him. 
An indoor baseball was used. A-record was made of the hand which rested nearer 
the batting end of the instrument and of the side of the body on which the bat 
was used. 


Before the results obtained on the bimanual tests can be studied 
in detail, the method of scoring the tests must be explained. The 
customary procedure in scoring bimanual tests is as follows: If the 
subject holds the right hand nearer the business end of the instrument 
and does the work on the right side of the body, a score of R is given. 
In sweeping, for example, if the subject places the right hand lower 
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on the broom and does the work on the right side of the body, he igs 
classified as a right-handed sweeper. On the other hand, if the 
subject places the left hand lower on the broom and does the work 
on the left side of the body, he is designated as a left-handed sweeper. 

This scheme of classification was used by Rife! and by Downey? 
in their studies of bimanual handedness. Both of these investigators 
found, however, that the majority of the human race sweep left- 
handed. In this investigation similar results were obtained. In the 
unselected group three hundred sixty-three of the five hundred eighteen 
subjects were found to be left-handed sweepers according to the 
customary classification. Similarly, three hundred seventy-two of the 
unselected group were left-handed in raking, and three hundred 
ninety-two were left-handed in shoveling. On the other hand, only 
twenty-four were left-handed in batting. 

These results indicate that something must be wrong with the 
customary classification as applied to the sweeping, raking, and 
shoveling tests. A classification according to which seventy per cent 
of an unselected population-group are left-handed in sweeping, in 
raking, or in shoveling cannot be very serviceable. For this reason 
the customary classification as applied to sweeping, raking, and 
shoveling will be reversed, and the handedness in the bimanual 
activities will be studied in terms of the new classification. 

Before turning to a study of the results obtained when the new 
classification is adopted, it is necessary to describe the way in which 
the scores were treated in those cases in which the subject held one 
hand nearer the business end of the instrument but did the work on 
the opposite side of the body, and in those cases in which the subject 
performed the activity in the R or L positions with equal ease. Cases 
of the former type were designated by the score Cr (crossed). Cases 
of the latter type in which the subject performed the activity in the 
R or L positions with equal ease, or in which the subject performed the 
activity in the two possible Cr positions with equal ease, were given 
a score of A. 

The results on the bimanual handedness tests will be analyzed 
from two points of view. In the first place, the relation of the scores 





1 Rife, J. M.: Types of Dextrality. Psychological Review, Vol. X XIX, 1922, 
pp. 474-480. 

2 Downey, J. E.: Types of Dextrality and Their Implications. American 
Journal of Psychology, Vol. XX XVIII, 1927, pp. 317-367. 
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on the four bimanual tests to one another will be studied. In the 
second place, the relation of the results of the bimanual tests to uni- 
manual handedness will be considered. 

Of the five hundred eighteen cases composing the unselected group, 
all but seventy-three made consistent scores on the sweeping, raking, 
and shoveling tests. That is, ninety individuals made a score of L 
(new classification) on these three tests, and three hundred fifty-five 
made a score of & on the three tests. The seventy-three cases in 
which consistent scores were not made on the three tests are tabulated 
in Table I. The data in Table I show, for example, that there were 
twenty-five subjects who made a score of L in sweeping, R in raking 
and in shoveling. 

The meaning of the close agreement between the scores on these 
three tests is obscured somewhat by the fact that, with few exceptions, 
there are practically only two possible scores, R or L, on each test. 
As a result of pure chance, therefore, complete agreement between 
the scores on all three tests would be obtained in twenty-five per cent 
of the cases. Since complete agreement was obtained in 85.91 per cent 
of the cases it is evident that the three tests measure some form of 
bimanual handedness. 


TaBLE I.—ScoreEs IN BIMANUAL TESTS FOR THE SEVENTY-THREE SUBJECTS IN THE 
UNSELECTED Group WuHo FAILED TO MAKE CONSISTENT SCORES ON THE 
SWEEPING, RAKING, AND SHOVELING TESTS 


ScorREs ON THE SWEEPING, RAKING, AND SHOVELING TESTS NUMBER 
L in sweeping, R in raking and in shoveling.................. 25 
R in sweeping, L in raking and in shoveling.................. 5 
Cr in sweeping, L in raking and in shoveling.................. 1 
Cr in sweeping, R in raking and in shoveling................. 2 
L in raking, R in sweeping and in shoveling.................. 17 
R in raking L in sweeping and in shoveling.................. 6 
A in raking, R in sweeping and in shoveling.................. 2 
R in shoveling, L in sweeping and in raking.................. 11 
L in shoveling, R in sweeping and in raking.................. 4 


ee Oe iia Ba satel 4 o 2:6 4k oe baie OM 73 


The relationship between the scores on the sweeping, on the 
raking, and on the shoveling tests and the scores on the batting 
test is shown by the data presented in Table II. The number of 
left-handed batters is much smaller than the number of individuals 
Who are left-handed in sweeping, raking, or shoveling. The data 
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also show that ten of the twenty-four left-handed batters are left- 
handed in sweeping, eleven are left-handed in raking, and eleven are 
left-handed in shoveling. The relationship between the scores on 
the batting test and the scores on either the sweeping, raking, or 
shoveling tests is not very close. The number of left-handed batters 
in an unselected group is much smaller than the number of left-handed 
sweepers. Also, only about one-half of the left-handed batters are 
left-handed in sweeping. This seems to indicate that there is a 
difference between the batting activity and the type of activity 
involved in sweeping, in raking, or in shoveling. A discussion of the 
probable nature of this difference will be presented as soon as the 
relation of bimanual handedness to unimanual handedness has been 
considered. 


TABLE I].—RELATIONSHIP BETWEEN THE SCORES IN BATTING AND THE 
OTHER BIMANUAL TESTS 

















: , ; | Score in batting 

Scores in sweeping, raking, —— 

, Number | 

or shoveling | 
| R | L | Cr 

| 
Scoring R in sweeping...............| 363 | 309 144 | 40 
Scoring L in sweeping............... 152 | 135 10 | 7 
Scoring Cr in sweeping.............. 3 2 0 | l 

} 

| 

Scoring R in raking................. 372 | 316 13 | 43 
Scoring L in raking................. 144 126 11 | 5 
Scoring Cr in raking................ 0 | 0 0 | 0 
Scoring A in raking................. 2 | 2 0 | 0 
Scoring FR in shoveling............... 392 | 336 13 | 43 
Scoring L in shoveling............... 126 | 110 11 | 5 
Scoring Cr in shoveling.............. Oo | 0 0 | 0 








In studying the relationship of bimanual handedness to unimanual 
handedness, the scores on the sweeping, raking, and shoveling tests 
will be combined into a single score since it has been shown that there 
is a close agreement between the results on these three tests. The 
combined score for a given subject will be taken as the score made 
on two of the three tests. Thus if a subject made a score of & on 
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the sweeping test and a score of L on the raking and shoveling tests, 
the combined score would be L. 

The data showing the relationship of the scores on the bimanual 
tests to unimanual handedness are presented in Table III. The 
figures in the first column refer to the combined scores on the uni- 
manual handedness tests. The figures in the second column show 
the number of subjects in the unselected group whose scores in the 
unimanual handedness tests were of a given magnitude. The figures 
in the third column indicate the number of subjects who made a 


TaBLE IIJ].—RELATION BETWEEN THE SCORES ON BIMANUAL TESTS AND 
UNIMANUAL HANDEDNESS 

















Unimanual _ Handedness in sweeping, | . ' 
handedness | raking, and shoveling | Handedness in batting 
_ Freq. in | | Propor- | | Propor- 
Score | uns. | R | OL tion | R | L | Cr tion 
| group | | of L | | of L 
—16 1 1 1.00 1 1.00 
—13 6 6 1.00 1 3 2 .50 
—10 10 1 9 .90 6 4 .40 
— 7 & 1 7 87 4 3 1 37 
— 4 6 1 5 .83 5 1 .00 
— 1 3 1 2 .67 3 .00 
2 16 10 6 my 14 1 1 .06 
5 39 32 7 .18 32 4 3 .10 
8 146 116 30 21 126 1 19 .07 
11 157 129 28 18 | 140 4 13 .03 
14 86 62 — 24 . oe 2 4 .02 
17 31 23 | 8 2. i 2 0 4 .00 
20 8 » 0 .00 | 7 1 .13 
23 1 1 0 .00 1 0 .00 


























combined score of R on the sweeping, raking, and shoveling tests. 
The figures in the fourth column indicate the number of subjects 
making a combined score of L in the three tests. The figures in the 
fifth column show what proportion of the subjects in a given interval 
scored left on the sweeping, raking, and shoveling tests. For example, 
there were six individuals in the unselected group who made a score 
on the unimanual handedness tests falling in the interval negative 
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thirteen up to but not including negative ten. Six of these subjects 
made a combined score of L on the sweeping, raking, and shoveling 
tests. The proportion making a score of L is, therefore, 1.00. The 
figures in the last four columns of Table III can now be easily inter- 
preted by the reader. 

The data in Table III are presented graphically in Fig. 1. The 
units on the horizontal axis represent unimanual handedness scores, 
The units on the vertical axis represent the proportion making a 
score of L. A study of Fig. 1 shows that handedness in sweeping, 
raking, and shoveling and handedness in batting vary directly with 
handedness in unimanual activities. A very high proportion of those 
scoring L in unimanual activities also scored L in sweeping, raking, 
and shoveling. In the region of ambidexterity in unimanual handed- 
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ness the proportion drops. As the right-hand region is entered the 
proportion drops still more, and remains low throughout the region 
of right-handedness in unimanual activities. The curve showing 
the proportion making a score of L in batting shows similar changes, 
but drops much more rapidly. Beginning with the negative four group 
the proportion remains very low. 

The data show that handedness in bimanual activities is related 
to unimanual handedness but that the relationship varies somewhat 
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with the type of activity tested. The scores on the batting test show 
a behavior different from that shown by the scores on the sweeping, 
raking, and shoveling tests. The curve for the scores on the sweeping, 
raking, and shoveling tests drops gradually as one passes from the 
left-hand end of the unimanual handedness scale to the right-hand 
region. The curve for the scores on the batting test drops very rapidly. 
From the results it appears that batting is an activity of such a type 
that left-handed individuals can easily learn to perform it in the right- 
handed way, or that there are stronger environmental influences 
operating to favor right-handed batting than is the case with such 
activities as sweeping, raking, and shoveling. One possible explana- 
tion for the fact that the proportion of left-handedness in sweeping, 
etc., is so much higher for the group as a whole than the proportion 
of left-handedness in unimanual activities, is that these activities 
involve the two hands and that it is, therefore, not as difficult for a 
left-handed individual to learn to perform a bimanual activity in 
the right-handed way as it is to learn to perform a unimanual activity 
in the right-handed way. In a bimanual activity the two hands 
must each develop some degree of skill. Whether a given individual 
will learn to perform the activity in the right-handed or left-handed 
way will depend more upon factors other than the handedness of the 
individual than is true for unimanual activities. It also appears that 
the way an individual uses a bat is more conspicuous than the way 
the broom or shovel is used. Handedness in batting might, therefore, 
be more subject to social influences, and this condition, plus the 
probable fact that it is less difficult for a left-handed individual to 
learn to use a bat right-handed than it is to learn to perform a uni- 
manual activity with the right hand, offers a possible explanation 
for the results obtained on the batting test. However, the foregoing 
explanations are only hypotheses and must be tested experimentally 
before any considerable weight is given them. 


SUMMARY 


1. The customary classification of handedness as applied to such 
activities as sweeping, raking, and shoveling is in error. According 
to the customary classification, the majority of the human race is left- 
handed in these activities, and bimanual handedness varies inversely 
with unimanual handedness. When the customary classification 
is reversed, the majority of individuals is designated as right- 
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handed and the direct relationship of bimanual handedness to uni- 
manual handedness is at once apparent. 

2. The handedness in bimanual activities varies somewhat with 
the nature of the activity tested. The handedness in such an activity 
as sweeping is more closely related to the handedness in such activities 
as raking and shoveling than to the handedness in such an activity as 
batting. 
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STORY COMPLETION TESTS 
GRACE H. KENT AND E. FRANCES WELLS 


From Danvers State Hospital, Hathorne, Mass. 


These two tests are based in principle upon the well-known Trabue 
Completion Tests.’ 

Whether a test be intended for school children or for clinical sub- 
jects, it is almost axiomatic that the material used should be of suffi- 
cient interest to hold the attention of the subject. Other things being 
equal, a one-page story is more interesting than is a page of detached 
sentences. But a child should not be required to leave a story unfin- 
ished, and for this reason a story would be unsuitable material for a 
test having a time limit. These tests were intended for standardiza- 
tion without time limit, and therefore it was possible to take advantage 
of the interest which a story naturally stimulates. 

The selection of material for any test which is to be used both 
for children and for adults presents a special problem. It is essential 
that the subject-matter be within the grasp of children at the lower 
age levels, and yet it should be free from any puerile content such as 
might tend to make an adult or adolescent subject feel foolish. In 
view of the inherent difficulty of meeting these conflicting require- 
ments, it seemed safer to fall back upon classics than to employ original 
literary material. 

After considerable study of fables and anecdotes, the fables ‘‘ Lion 
and Mouse” and “‘The Fir Tree” were adopted, largely on the ground 
that each can be reduced to one-page length without omitting any- 
thing essential. Following are the two stories in the form used, with 
blank spaces which are indicated by numbers in parentheses. 


Name Only one word in each space. 


A great lion (1) sleeping in the woods. A little mouse ran (2) him 
and wakened him. The (3) sprang (4) =andcaughtthe (5) under 
(6) paw. The mouse said: “If you will (7) mego,someday (8) 
will (9) useful to (10).” The (11) laughed and answered: ‘You 
(12) too (13) to be (14) any use (15) me; but (16) 

will let you (17) , because lions (18) generous.” 
A few days (19) this, the lion was (20) in a snare. He roared 
(21) rage, and all the (22) in the woods could (23) him. The 
little (24) came running to (25) place, to find (26) the reason 





1Trabue, M. R.: “Completion Language Test Scales.’”’ Columbia Contri- 
butions to Education, 1916. 
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(27) all this noise. The mouse (28) to the lion: “I promised you 

(29) some (30) I would be (31) to you. My (32) are very 
sharp, and I (33) cut the cords of this (34) . I will (35) you 
free.” 

Sothe (36) gnawedattheheavy (37) whichheldthelion’s (38) 
Finally the cords were (39) through,andthe (40) wasset (41) 


Name Only one word in each space, 


A small fir (1) grew in (2) woods. The tree said: ‘‘No one cares 
(3) me, because (4) needles are (5) so beautiful (6) the 

leaves of the other (7) . If only I had (8) _ of gold, people would 
like (9) bestof (10) .” 

The (11) morning the wish (12). true, andthe tree (13) leaves 
of pure (14) . But (15) soon (16) man picked off (17) the 
leaves, and carried (18) away ina bag. 

Then the tree (19) for leaves of glass, and (20) wish also came 

(21) . The (22) leaves sparkled inthe (23) ,andthe (24) 
wasvery (25) . Butafterawhile (26) stormarose,andthe (27) 
shook the trees. All the pretty glass (28) were (29) off. 

Afterthat (30) treewishedforgreen (31) ,likethoseofthe (32) 
trees. But (33) this wish was granted, a goat (34) along and ate 
off (35) leaf. 

Then the tree (36) : “My (37) were the best, because I could 
(38) them all the (39) . How I wish (40) had my (41) 
needles back!” The next (42) this (43) came true, and the fir tree 

laughed (44) joy. 


METHOD Of STANDARDIZATION 


Preliminary standardization of these tests was accomplished as a 
by-product, by a method already described.! 

A battery of seven short tests, prepared for group standardization, 
was given to about one thousand children in the public schools of 
Lynn, Massachusetts. The children were from Grades III to IX, 
and their ages ranged from eight to fourteen. The battery included 
a new sentence completion test, ‘‘Woodworth-Wells Hard Direc- 
tions,’’? and a revised edition of five Kent-Shakow group tests. Sen- 
tence Completion, the only one having a time limit, was presented first; 





1 Kent, G. H., and Shakow, D.: Group Tests for Clinical Studies. Journal 
of Genetic Psychology, Vol. XX XV, 1928, pp. 595-618. (See p. 611.) 
Kent, G. H.: “Battery of Seven Tests.” 
2 Woodworth, R. S., and Wells, F. L.: Association Tests. Psychological 
Monographs, No. 5, 1911. 
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after which the other six tests were given out together, in such a way 
as to permit each child to set his own pace. The forms! of the Story 
Completion tests were held in reserve, and later were presented individ- 
ually to those children who completed the battery early in the period 
and who therefore had time for extra work. The story tests thus 
furnished a convenient means of keeping the rapid workers busy 
while the slow workers were still occupied with the battery. 

In Grade III preference was given to ‘‘Lion and Mouse,” as being 
the easier test. In other grades the number given out was kept 
approximately equal for the two tests. “Lion and Mouse” was 
completed by four hundred forty-four children, and “Fir Tree”’ 
by four hundred twenty-eight children. There were six hundred 
twenty-two children who completed the battery in time to perform 
at least one of the extra tests, and two hundred fifty of these— 
obviously the very rapid workers—had time to complete both. Thus 
the children who took part in these tests do not constitute a repre- 
sentative group of school children, because the slow workers were 
entirely excluded. For this reason we are not using the records for 
independent standardization of the tests, but merely for deriving 
such norms as can be obtained by correlation with the battery. 


EVALUATION OF RESULTS 


The chief purpose of these tests is to offer the subject an oppor- 
tunity to produce a logically coherent story." They were not intended 
as tests of memory or verbal association, nor primarily as tests of 
ability to use language correctly. 

A scoring system should be sufficiently flexible to meet the demands 
of the material without being so complex as to be unwieldy. In a 
test having forty items which are not arranged in order of difficulty, 
the weighting of values for individual items would increase the diffi- 
culty of scoring far more than it would increase the accuracy of results. 
It seems best, therefore, to allow the same credit for all items, although 
they vary widely in difficulty. 





‘Mimeographed copies were used for the blank forms, made by stencils 
prepared on a typewriter having pica type. The lines were triple-spaced. In 
order to allow ample room for writing the longer words, without wasting the page, 
the blank spaces were graduated roughly according to the length of the words to 


rs ~~ (Sample copies of the forms will be furnished on application.— 
. H. K.) 
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A preliminary study of the records revealed a considerable variety 
of responses for almost any given item. In many instances two or 
more of the words seemed equally to merit full credit; other responses 
seemed to merit partial credit, although they were less satisfactory; 
and still others were unquestionably inadequate. Findingit impossible 
to draw a sharp line between “‘right”’ and “‘ wrong” responses without 
being arbitrary, we decided to allow two points for each response that 
is wholly satisfactory and one point for each inferior response that 
makes fairly good sense. 

It is frequently difficult to decide whether a given response belongs 
in the superior or inferior group. In order to reduce the effect of 
personal equation, a few general rules have been formulated to serve 
as a guide in scoring. Although these rules still leave much to individ- 
ual judgment and therefore do not wholly eliminate the personal factor, 
it seems better to admit this source of error than to introduce the 
errors which an inflexible scoring system involves. 


GENERAL RULES FOR SCORING 
Four criteria are recognized, as follows: 


1. Appropriateness of the response. To receive any credit, it is essential that 
the response makes good sense in relation to the context. 

2. Clearness with which the appropriate meaning is conveyed. 

3. Grammatical correctness of the construction. 

4. Observance of the instructions—to write only one word in a space. 


Two-point credit is allowed for any response which satisfies all 
four of these requirements. 

One-point credit is given for a response which meets the first condi- 
tion but which violates any one of the other three. Thus: 


(a) A word which is grammatically incorrect and awkward, but which conveys 
the appropriate meaning clearly. 

(b) A word which does not convey the meaning clearly, but which is grammati- 
cally correct. 

(c) A two or three word response which meets the first three conditions. 


No credit is allowed for words which do not make good sense in 
the context, nor for grammatically incorrect words which do not 
convey the meaning clearly. 

No credit is deducted for incorrect spelling, provided that the 
meaning be clear in spite of the error. 
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The records were scored according to these principles. The points 
for full-credit responses were totaled and recorded as the First Score. 
The points for half-credit responses were then added to the first score, 
and the total number of credits was recorded as the Second Score. 

The words for which we have given credit are listed in the keys, 
the items being referred to by number. Responses which receive full 
credit are in bold-face type, followed by the half-credit responses in 
plain type. These lists are purely empirical, and are not exhaustive. 
They were developed in the process of scoring the records, each new 
response that was found being added to the list. The individual 
examiner will doubtless have occasion to add other words from time 
to time according to the demands of the results. 


Key For LION AND MovussE 


(1) Lay, was—is, lie. (2) Across, over—about, around, before, beside, by, 
into, near, on, onto, to, towards, up, upon, up to. (3) Lion—cat. (4) Forward, 
quickly, suddenly, up—after, at, at him, for, forth, quick, upon. (5) Mouse— 
rascal, rat. (6) His—her, its, the. (7) Let—leave. (8) I. (9) Be. (10) You. 
(11) Lion. (12) Are. (13) Little, small. (14) Of. (15) To—too. (16) L 
(17) Go, live—free, loose. (18) Are—were. (19) After. (20) Captured, caught, 
trapped—tangled, tied. (21) In, with—for, in a. (22) Animals, creatures, 
hunters, people—birds, lions, mice, neighbors, others, rats, squirrels, trees. 
(23) Hear—not help. (24) Mouse—rat. (25) The—his, that, this. (26) Out— 
what. (27) For—of, was for. (28) Said—yelled. (29) That—once. (30) Day, 
time—some day. (31) Useful, helpful—a help, generous, good, kind, of service, of 
use. (32) Teeth—little teeth. (33) Can, will—could, shall, ’ll. (34) Net, snare, 
trap—cage, rope. (35) Set—cut, get, let, make. (36) Mouse—rat. (37) Cord, 
cords, net, rope, ropes—snare, trap. (38) Body, feet, legs, paws—foot, head, paw. 
(39) Cut, gnawed—all cut, bitten, broken, eaten, torn. (40) Lion. (41) Free— 
loose. 


Key ror Fir TREE 


(1) Tree—once. (2) The—a, some. (3) About, for. (4) My—prickly, the. 
(5) Not—never, n’t. (6) As—like. (7) Trees—tree. (8) Leaves—needles, some, 
those. (9) Me—mine, them. (10) All—course. (11) Following, next—same. 
(12) Came—come. (13) Had—bore, grew, has. (14) Gold. (15) Pretty, 
very—quite, then. (16) A, some—the. (17) All—some of. (18) Them—it. 
(19) Longed, wished, yearned—asked, begged, sighed, cried, wish. (20) That, 
this—her, his, its, the. (21) True. (22) Glass—beautiful, new, pretty, tree’s. 
(23) Sun, sunlight, sunshine—forest, light, moonlight, woods. (24) Fir, tree— 
glass, leaves, others, sight. (25) Beautiful, happy, pretty, proud—bright, glad, 
handsome, jealous. (26) A—the. (27) Wind—storm. (28) Leaves— 
leaf, leave, needles. (29) Blown, broken, shaken—broke, fallen, falling, 
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knocked, shook, taken, torn. (30) The. (31) Leaves—leaf. (32) Ordinary, 
other—big, elm, maple, pretty. (33) After, when—although, as soon as. (34) 
Came—went. (35) Every—each. (36) Said, sighed, thought—cried, mourned. 
(37) Needles—leaves. (38) Have, keep—own, wear. (39) Time, year. (40) 
I. (41) Fir, old, own—beautiful, dear, green, lovely, nice, pointed, pretty, sharp, 
(42) Day, morning—minute, summer, time, year. (43) Wish—also, one. (44) 
For, with—in, of. 


DEVELOPMENT OF Norms 


The battery yielded seven independent mental age ratings for 
each child, and the median of seven was accepted as the final rating. 
The Story Completion records were grouped according to these ratings 
instead of according to the ages of the children, and the scores for 
each age-level were arranged in serial order. At any given level 
the actual ages of the children varied widely. At the ten-year level, 
for example, the chronological ages ranged all the way from eight to 
fourteen. 

Tables I and II show the median scores for each level, with the 
range of variation. The medians are shown also in graphic form, 
in Figs. 1 and 2. The solid lines show the first score medians, and the 
broken lines the medians for the second score. 

It will be noted that the median scores at the nine-year level 
are only slightly above those of the eight-year level, which indicates 
that the tests are rather too difficult at nine years. It is from ten 
to fourteen years that they are clearly discriminative, and we do 
not expect them to be of any considerable use outside of this range. 

The norms which we are using, derived from the medians, are 
shown in Table III. The curves have not been altered, but they have 
been extended at the upper end so as to give a rating of fourteen-plus 
for a score that is clearly too high to be counted as fourteen. In each 
instance. the actual median for a given level is included within the 
range for the corresponding age. 

We use the second score in preference to the first score; however, the 
norms by the first score are given in full for the convenience of any 
who may prefer this method of scoring. 


SERVICEABILITY OF THE TESTS 


These tests have seen some service in Danvers State Hospital, 
both in the Child Guidance Clinic and in the study of adult hospital 
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patients. They appear to be exceptionally attractive tests and to 
furnish a task of absorbing interest. Inadequate as the norms are, 
we have found the tests useful in their present state, and it is on this 
ground that we offer them for the use of other clinics. Written tests 
which have no time limit are at a premium, especially for individual 
studies. 

Standardization of tests on a large scale is a project for school 
systems rather than for state hospitals, and we are not prepared to 
carry the development of these tests any further. If they should be 
used as group tests for classification of school children, material might 
be available for adequate standardization. In the meantime we can 
safely recommend them for use in school clinics as individual tests, 
They are offered, of course, merely as furnishing one more element in an 
examination, preferably to be used as one unit of a battery. It is 
obvious that no subject should be given a rating based wholly upon so 
simple a test, even properly standardized. (In this hospital we do not 
make a practice of rating a subject by any single test, whether simple 
or composite.) 

The two tests are intended to be used singly rather than 
together. Either is probably sufficient to offer a rough measure 
of whatever aptitude is measured by completion tests. “Lion and 
Mouse”’ is to be preferred for children under twelve years of age or for 
adults who rate below twelve, and ‘“‘Fir Tree’”’ is recommended for any 
subject who may reasonably be expected to rate upward of thirteen. 


SUMMARY 


Two simple and well-known fables have been arranged for use as 
story completion tests. In each test approximately forty words were 
deleted, each being represented by a blank space. The subject is 
expected to fill in the words required to complete the story. Two- 
point credit is allowed for every satisfactory word supplied, and one- 
point credit for an inferior response which makes good sense in the 
context. The final score is the sum of these credits. 

The tests have been tentatively standardized upon over four hun- 
dred children, by correlation with the median ratings which these 
children achieved in a battery of seven short units. The age-curves 
required no essential correction. 

The tests are given without time limit. They are intended 
primarily for use in individual examination of clinical subjects, but can 
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| First score Second score 
Age level | —— Number 
| Median Range Median Range of cases 
s | 35 6-62 39.5 6-66 22 
9 40 8-64 44 9-67 39 
10 | 58 28-78 62 33-79 57 
11 | 62 42-74 67 44-78 77 
12 | 68 34-80 70.5 39-80 127 
13 72 54-82 74 58-82 107 
14 74 66-78 77 69-80 15 
TaBLe II.—Fir Tree 
| First score | Second score 
Age level | -—- | Number 
| Median Range | Median | Range of cases 
8 33 | 34-52 | 44 35-52 5 
9 42 0-74 | 44 2-75 26 
10 57 =| 22-84 | 61 25-84 50 
11 66 _ 84-74 70 37-77 85 
12 70 24-88 | 74 28-88 134 
13 74 46-86 | 77 51-87 112 
14 80 | 56-86 | 82 61-87 16 
TaB_Le III.—TentativeE Norms 
Lion and Mouse Fir Tree 
Age level ) 
First score | Second score | First score | Second score 
10 52-58 * 56-64 52-60 | 56-65 
11 60-64 ~ 65-68 62-66 66-71 
12 66-68 69-72 68-72 | 72-75 
13 70-72 73-76 74-76 | 76-79 
14 74-78 77-79 78-82 80-84 
14+ 80-82 | 80-82 84-88 | 85-88 
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SEX DIFFERENCES IN ALGEBRAIC ABILITY 


GLENN R. PEASE 


College of the Pacific 


The author has no desire to review the literature respecting sex 
differences in algebraic ability; in fact he knows of but little which 
could be reviewed. His only interest is in adding some data that seem 
worthy of consideration in connection with this subject. 

After comparing the scores of three hundred sixty-four boys and 
three hundred twenty-one girls who were given the forty element 
I.E.R. test to quadratics, Thorndike states: ‘‘The evidence supports 
the conclusion that the sexes are of approximately equal ability.” 
(“Psychology of Algebra,’ p. 414.) After noting Thorndike’s con- 
clusion, it seemed worth while to the author to study sex differences in 
algebraic ability in connection with a rather extended research carried 
on for an entirely different purpose. The present report is really an 
appendix to a study printed in The Mathematics Teacher of May, 1929, 
under the title, An Analysis of the Learning-units in N Processes in 
Algebra. If the reader desires a more detailed statement of the 
manner of setting up the tests, and the carrying out of the test program 
than is included here, it can be found in that article. 

The field of abstract whole-number problems in addition, subtrac- 
tion, multiplication, division, parentheses, and algebraic concepts was 
analyzed for possible learning-units, of which the author located a 
total of 770 in the following order: addition, 125; subtraction, 130; 
multiplication, 154; division, 77; parentheses, 19; algebraic concepts, 
36; and others in combination of addition and subtraction, and in the 
use of algebraic shorthand. 

On the basis of this analysis, tests were constructed with one or 
more representative problems for each of the above identified learning- 
units. These tests were given as soon as the particular part of the text 
corresponding to the test had been completed by the class. For exam- 
ple, as soon as they had covered the portion of the text relating to 
addition of known numbers, the corresponding test was given. There 
were a total of twenty-three tests with coefficients of reliability ranging 
from .69 to .94, the reliability being determined by correlation of 
chance halves and the use of Brown’s formula. 

The high schools cooperating in the test program give a good sam- 
pling of first year algebra pupils in the Middle West. They were 
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Oskaloosa, Albia, and Charles City, lowa, and Marshall, Missouri— 
Charles City completing the test program when Marshall dropped out. 
The textbooks represented were: Wells and Hart, Modern First Year 
Algebra; Newell and Harper, A Year of Algebra; Schorling and Clark, 
Modern Algebra, Ninth School Year. 

These cities are all small enough to insure a good sampling of rural 
children. Two are in the coal mining section of Iowa, two are railroad 
division points, two have small colleges within their environs, and all 
of them are in a small way manufacturing cities. This should give a 
good sample of pupil ability as the research includes test data from all 
pupils enrolled in Algebra I, with the exception of ‘‘repeaters.”” The 
accompanying table gives the results in terms of raw data on all prob- 
lems in each test; also with data corrected to wrongs per one hundred 
pupils. 

The data would seem to be worthy of consideration, inasmuch as 
they are drawn from a minute covering of the field over which the 
tests extended, every learning-unit being presented as a test problem— 
in fact, it is probable that no such complete testing program has ever 
been undertaken in the field of Algebra research. The number of 
pupils whose test results go to make up the data is sufficiently large 
to give an adequate sampling of pupil ability. 

It will be noted from the table that in only one case did the boys 
show as few wrong problems per one hundred cases as did the girls, 
that of horizontal addition of literal numbers, where the boys made 444 
wrongs to the girls 480 wrongs. In every other test the girls had the 
advantage of the boys in terms of correct solving of the problems. 
The corrected data totals show that the boys made 2096 more errors 
per hundred pupils than did the girls. Or, putting the results in terms 
of the average pupil, the average boy made 163.77 errors, to 142.81 
errors per average girl. 

Inasmuch as Iowa has no compulsory high school attendance law, 
and the opportunities for slightly over-age boys to work in the mines 
are quite plentiful, the real differences are probably even greater than 
the data show, for the girls represent a less highly selected group than 
the boys. While the author would not infer that the findings should 
be taken at face value, they do seem to indicate a slight superiority in 
algebraic ability in favor of the girls. 
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NUMBER OF WRONG PROBLEMS IN TWENTY-THREE TESTS TAKEN BY Boys anp 























GIRLS 

Field of test Boys| Wrongs vs Girls | Wrongs ii 
Vertical addition, knowns........... | 163 593 364 192 688; 358 
Horizontal addition, knowns. . ..| 156 528; 340 196 489) 250 
Vertical addition, literals...........| 155} 1,031) 665) 188 1,246) 663 
Horizontal addition, literals. . | 173 768, 444! 178 855) 480 
Addition, polynomials... . «161 603} 375) 183 431) 236 
Vertical subtraction, knowns. . 176 524, 298 181 485, 268 
Horizontal subtraction, knowns... . 176, 1,467) 834 181) 1,417; 783 
Vertical subtraction, literals........ | 169 1,015) 601) 181) 1,048) 579 
Horizontal subtraction, literals....... 152} 2,084) 1,371) 187) 2,108) 1,127 
Inverted form. . Serer ae 510} 323) 186 519} 279 
Subtraction, polynomials. Pe aes outa | 165 789, 484 183 752); 411 
Vertical multiplication, knowns... .. — 165 221 134; 185 208; 112 
Horizontal tl ag knowns...| 165 454, 275) 185 465, 261 
Multiplication, literals. . -| 161) 1,580) 981) 179) 1,396) 780 
Special products. . . .| 164) 1,122} 684 181) 1,001) 553 
Monomials times poly neuslals.. | 158) 2,008) 1,271) 190) 2,080) 1,095 
Division of knowns............... | 156) 648; 415) 182} 548 301 
Division of literals. . | 150) 2,138) 1,425) 179] 2,332) 1,303 
Removing parentheses .. ...| 168) 1,861) 1,112) 192) 1,803) 939 
Addition and subtraction, knowns. ... 165) 2,072) 1,256, 184) 1,934 1,051 
Addition and subtraction, literals.... 158} 1,781) 1,127) 187) 2,065 1,104 
Algebraic shorthand.......... 148 631; 426) 187 623) 339 
Algebraic concepts. . 152} 1,781) 1,172; 184 1,874 1,019 
Totals. . oe tie oe 3,714| 26,209|16,377/4,251| 26,367/14,281 

Se ee ee ee 161+ 184+ 
Average, wrong problems per boy.... . 163.77) per girl... . 142.81 








Reading first line: 163 boys had a total of 593 wrongs in the test in vertical 
addition of known numbers. Corrected to number of wrongs per one hundred 
cases, we have 364 wrongs. 

One hundred ninety-two girls had a total of 688 wrongs in the same test. Cor- 
rected to wrongs per one hundred cases we find 358. Thus the columns headed 
“corrected” are comparable—the number of wrong problems per one hundred 
boys with the number of wrong problems per one hundred girls. 
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NEW PUBLICATIONS IN EDUCATIONAL 
PSYCHOLOGY AND RELATED FIELDS OF 
EDUCATION seen 


CONDUCTED BY FRANCES M. FOSTER 











Problem Tendencies in Children, by Willard C. Olsen. Minneapolis: 
The University of Minnesota Press, 1930. Pp. 92. 


Any work that deals in a reasonably objective and as far as possible 
quantitative manner with behavior problems is welcome. We do 
not expect too much of these books individually. We ask only that 
they contribute something toward techniques that may be increasingly 
scientific. | 

Dr. Olsen has used a scale previously published, called here 
“Schedule A—Behavior Problems Record.” This is merely a con- 
venient form on which teachers may record overt behaviors. The 
frequencies of record are then weighted, and a summation gives the 
child’s general tendency to behave atypically. In addition, in this 
study ‘‘Schedule B—Behavior Rating Scale’ has been developed. 
This is a five point ‘‘descriptive phrase”’ scale for rating thirty-five 
tendencies. The ratings are weighted on the basis of analysis of 
numerous ratings. Deviates in either direction from the norm are 
weighted positively. The composite score gives a general measure of 
the rater’s opinion of the child’s tendency to deviation from the norm 
in behavior. The reliabilities of Schedule B (used with 1537 children 
in Minneapolis first grades, six hundred twenty-six children in several 
schools from Grades I-VIII, and some nursery school children) 
are as follows: Repeated ratings for the scale as a whole the self ‘‘r”’ 
averages .86; splitting the scale and raising the split half correlation 
gives .92, correlations between different raters are in the neighborhood 
of .60. 

Schedules A and B measured the same thing to the extent repre- 
sented by a correlation coefficient of .62 (.73 when corrected for 
attenuation). Certain clinical cases showed very strikingly high 
ratings. 

Dr. Olsen is sufficiently restrained in his conclusions. He finds 
associations between scores on the Behavior Rating Scale and (a) 
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sex, (b) school achievement, (c) intelligence. (Generally boys had 
higher mean scores than girls, and low intelligence [in these groups] 
tended to be associated with a higher behavior deviation score.) 
He finds higher correlations between behavior rating tendencies 
and achievement test scores than between behavior ratings and 
intelligence test scores. 

No attempt is made to offer completely generalized interpretations 
of the findings. It may fairly be said that the schedules are interesting, 
and are fairly reliable and valid as these techniques go. They should 
certainly be known, used, and experimented with by researchers 
in this important field. It cannot be held against them that they do 
not offer much immediately to classroom teachers. 


DoNALD SNEDDEN. 
New York University. 





A Point Scale of Performance Tests, Volume I, Clinical Manual, by 
Grace Arthur. New York: The Commonwealth Fund, Division 
of Publications, 1930. Pp. IX + 82. 


This work gives a brief history of the work, a description of the 
tests, explicit directions for administering them, and tables of norms. 
Volume II, not yet published, will contain ‘‘a full account of the 
work of standardization together with alternative forms of scoring 
and their results.” 

This point scale, as described in Volume I, has two advantages over 
existing performance composites: 

1. It is in two forms. Form I and Form II are standardized to 
be given one year apart. This, of course, permits of rather satisfactory 
follow-up retesting. 

2. All of the standardization was done on the same group of 
children. Eleven hundred were used with Form I, and five hundred 
thirty-five of the same children with Form II one year later. This 
gives authority to the norms for the two forms of the scale. 

The tests making up the scale are, in the main, the familiar ones 
that are used in the Pintner-Paterson Performance Scale. In addition 
the Porteus Mazes, the Kohs Block Design Tests, and the Healy 
Pictorial Completion II have been incorporated in the scale. These 
various tests were selected on the basis of ‘their ability to discriminate 
between successive chronological age levels.”’ 
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The chief disadvantage of the scale as a whole is its inelasticity. 
Good age norms are available for the total point score, but not for 
the separate tests. This means that in case a test is “spoiled” an 
adjustment (that is not simple) has to be made to the incomplete 
total score. 

It seems to the reviewer that the advantages far outweigh the 
disadvantages and that the scale should have and will have a very 
wide clinical usefulness. DonaLD SNEDDEN. 

New York University. 





The Growing Boy, by Paul Hanly Furfey. New York: The Macmillan 
Co., 1930. Pp. VIII + 192. $2.00. 


Growing up continues to be a popular subject with sociologists 
and psychologists. Dr. Furfey describes in concise and readable 
form some of the facts about the physical, mental, and personality 
traits of one hundred sixty-eight boys at ages six, eight, ten, twelve, 
fourteen, and sixteen. His description includes the central tendencies 
of behavior at these ages as well as brief studies of individual boys. 
These studies reveal the wide variation from the average in the develop- 
ment of individuals of the same life age, and the large amount of 
overlapping in the development of individuals from age to age. 
Development during the first six years of life is summarized briefly, 
and adolescence receives special emphasis. Results of objective 
studies and opinions of leading authorities are included in the discussion 
of each level. The author concludes that the age of six marks the 
transition point from home to school and the beginning of social 
group contacts. The eight-year-old period is characterized by indi- 
vidualism, the ten-year period marks the beginning of the gang age, 
at twelve the gang age reaches its height and the boy is in a transition 
period between childhood and adolescence, the fourteen year level 
continues to be a period of transition characterized by lack of homo- 
geneity in members of the group studied and by difficulty in adjust- 
ment. By the age of sixteen the boy is mentally and physically mature 
but not yet well-adjusted emotionally. 

Some of the author’s statements concerning characteristics of 
stages of growth appear to be more largely a matter of opinion than of 
scientific fact. Whether the eight-year period is more predominantly 
individualistic than other periods and what the chronological limits of 
the gang age really are depend somewhat upon definition and inter- 
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pretation. More emphasis might well have been given to the con- 
tinuity of growth and the imperceptible shading from one period to 
another rather than to growth in terms of differentiated stages. A 
description of how children learn, how concepts and meanings are 
acquired from birth to maturity, is almost entirely omitted from the 
present discussion, though it assuredly deserves a place in any study 
of growing children. Adequate and well-chosen bibliographies appear 
at the close of each chapter. GERTRUDE HILDRETH. 
Lincoln School of Teachers College 
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